[ 628.371718] env[69238]: INFO neutron.common.config [-] Logging enabled! [ 628.372810] env[69238]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43 [ 628.372810] env[69238]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69238) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 628.372810] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 628.372810] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 628.373447] env[69238]: WARNING oslo_policy.policy [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 628.373667] env[69238]: WARNING oslo_policy.policy [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 628.375161] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] VMware NSXv3 Agent initialized successfully. [ 628.376138] env[69238]: DEBUG oslo_concurrency.lockutils [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] Acquiring lock "singleton_lock" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.376138] env[69238]: DEBUG oslo_concurrency.lockutils [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] Acquired lock "singleton_lock" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.376280] env[69238]: DEBUG oslo_concurrency.lockutils [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] Releasing lock "singleton_lock" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.376655] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] Full set of CONF: {{(pid=69238) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 628.376753] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ******************************************************************************** {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 628.376847] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] Configuration options gathered from: {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 628.379107] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 628.379107] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 628.379107] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ================================================================================ {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 628.379107] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] agent_down_time = 75 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379107] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] allow_automatic_dhcp_failover = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379107] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] allow_bulk = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379376] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] api_extensions_path = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379376] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] api_paste_config = api-paste.ini {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379376] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] auth_strategy = keystone {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379376] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] backdoor_port = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379376] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] backdoor_socket = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379376] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] backlog = 4096 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379376] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379573] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] bind_host = 0.0.0.0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379573] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] bind_port = 9696 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379573] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] client_socket_timeout = 900 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379649] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] config_dir = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379757] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.379998] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] config_source = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.380259] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] control_exchange = neutron {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.380489] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] core_plugin = ml2 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.381053] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] debug = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.381053] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] default_availability_zones = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.381867] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.381867] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] dhcp_agent_notification = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.381867] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] dhcp_agents_per_network = 1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383121] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] dhcp_lease_duration = 86400 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383121] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] dhcp_load_type = networks {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383121] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] dns_domain = openstacklocal {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383121] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383121] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] enable_default_route_bfd = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383121] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] enable_default_route_ecmp = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383121] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] enable_dvr = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383829] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] enable_new_agents = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383829] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383829] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] enable_signals = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.383829] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] enable_traditional_dhcp = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.384032] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] external_dns_driver = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.384181] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] filter_validation = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.384397] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] global_physnet_mtu = 8950 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.384680] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] graceful_shutdown_timeout = 60 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.384838] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] host = cpu-1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.385596] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] host_dvr_for_dhcp = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.385596] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] http_retries = 3 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.385596] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] instance_format = [instance: %(uuid)s] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.385809] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.385858] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ipam_driver = internal {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.386043] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ipv6_pd_enabled = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.386236] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] l3_ha = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.386432] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.386641] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] l3_ha_network_physical_name = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.386845] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] l3_ha_network_type = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.387084] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_color = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.387301] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_config_append = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.387793] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.387793] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_dir = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.387926] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_file = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.388088] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_options = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.388248] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_rotate_interval = 1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.388395] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_rotate_interval_type = days {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.388537] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] log_rotation_type = none {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.388644] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.388763] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389339] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389339] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389339] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389339] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] max_dns_nameservers = 5 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389883] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] max_header_line = 16384 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389883] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] max_l3_agents_per_router = 3 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389883] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] max_logfile_count = 30 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.389883] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] max_logfile_size_mb = 200 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.390469] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] max_subnet_host_routes = 20 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.390469] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] my_ip = 10.180.1.21 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.390469] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] my_ipv6 = ::1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.390649] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] network_auto_schedule = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.390838] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] network_link_prefix = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.391261] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.391261] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] notify_nova_on_port_data_changes = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.391415] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] notify_nova_on_port_status_changes = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.391603] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] pagination_max_limit = -1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.391792] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] publish_errors = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.391980] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] rate_limit_burst = 0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.392406] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] rate_limit_except_level = CRITICAL {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.392406] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] rate_limit_interval = 0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.392509] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] retry_until_window = 30 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.392643] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] router_distributed = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393100] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] rpc_resources_processing_step = 20 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393100] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] rpc_response_max_timeout = 600 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393100] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] rpc_response_timeout = 60 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393252] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] send_events_interval = 2 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393624] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] service_plugins = ['router'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393624] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] setproctitle = on {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393624] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] shell_completion = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.393740] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] state_path = /opt/stack/data/neutron {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394074] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] syslog_log_facility = LOG_USER {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394074] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] tcp_keepidle = 600 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394174] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] transport_url = **** {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394509] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] use_journal = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394509] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] use_json = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394653] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] use_ssl = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394959] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] use_stderr = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394959] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] use_syslog = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.394959] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] vlan_qinq = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.395112] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] vlan_transparent = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.395217] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] watch_log_file = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.395526] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] wsgi_default_pool_size = 100 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.395526] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] wsgi_keep_alive = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.395663] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.395933] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] wsgi_server_debug = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.395933] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_concurrency.disable_process_locking = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.396735] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.396735] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.396735] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.396735] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.396735] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.396735] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.396969] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.connection_string = messaging:// {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.397041] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.enabled = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.397188] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.es_doc_type = notification {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.397326] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.es_scroll_size = 10000 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.397467] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.es_scroll_time = 2m {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.397606] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.filter_error_trace = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398270] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.hmac_keys = **** {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398270] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.sentinel_service_name = mymaster {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398270] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.socket_timeout = 0.1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398270] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.trace_requests = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398583] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler.trace_sqlalchemy = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398583] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler_jaeger.process_tags = {} {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398583] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler_jaeger.service_name_prefix = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398837] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] profiler_otlp.service_name_prefix = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.398837] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.enforce_new_defaults = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.399679] env[69238]: WARNING oslo_config.cfg [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 628.399679] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.enforce_scope = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.399679] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.policy_default_rule = default {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.399679] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.399855] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.399959] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.400096] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.400275] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.400417] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.400790] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.400790] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.400855] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.401486] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] agent.extensions = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.401486] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.401486] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] service_providers.service_provider = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.401486] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.default_quota = -1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.401641] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.401809] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_floatingip = 50 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.402164] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_network = 100 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.402164] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_port = 500 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.402380] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.402565] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_router = 10 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.402712] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_security_group = 10 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403389] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403389] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.quota_subnet = 100 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403389] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] QUOTAS.track_quota_usage = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403389] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403635] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep.group = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403635] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep.helper_command = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403691] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.403803] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep.thread_pool_size = 8 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.404061] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep.user = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.404146] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.404546] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_dhcp_release.group = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.404546] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_dhcp_release.helper_command = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.404546] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.404749] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.404749] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_dhcp_release.user = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.405611] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.405611] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_ovs_vsctl.group = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.405611] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.405611] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.405611] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.405926] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_ovs_vsctl.user = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.405926] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_namespace.capabilities = [21] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406031] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_namespace.group = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406176] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_namespace.helper_command = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406319] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406470] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406768] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_namespace.user = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406768] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_conntrack.capabilities = [12] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406891] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_conntrack.group = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.406998] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_conntrack.helper_command = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.407214] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.407286] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.407408] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_conntrack.user = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.407669] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_link.capabilities = [12, 21] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.407669] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_link.group = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.407988] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_link.helper_command = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.407988] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.408089] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_link.thread_pool_size = 8 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.408389] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] privsep_link.user = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.408389] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.408524] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.408642] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.continue_on_failed_promotions = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.408890] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.dscp = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.408952] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.dscp_inherit = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.409272] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.force_mp_to_policy = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.409272] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.locking_coordinator_url = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.409370] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.log_agent_heartbeats = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.409612] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.logging_expire = 1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.409612] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.410075] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.410075] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.polling_interval = 240 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.410075] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.410234] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.410378] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.report_interval = 30.0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.410521] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411618] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411618] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411618] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.sync_skew = 60 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411618] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.synchronization_queue_size = 20 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411618] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT.use_helper_for_ns_read = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411618] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] SECURITYGROUP.enable_ipset = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411978] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] SECURITYGROUP.enable_security_group = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411978] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411978] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.411978] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] experimental.ipv6_pd_enabled = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.412112] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.extension_drivers = ['port_security'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.412249] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.external_network_type = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.412404] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.412955] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.overlay_ip_version = 4 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.412955] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.path_mtu = 8950 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.412955] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.physical_network_mtus = {} {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.412955] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.413197] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.413784] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ml2.type_drivers = ['vlan'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.413784] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.413784] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.413784] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.413933] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.413960] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.414116] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.414252] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.414870] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.414870] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.414870] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415026] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_login_password = **** {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415189] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415189] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_login_user = admin {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415335] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415485] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415843] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415843] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.415967] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.416050] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.416198] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.416379] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.416478] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.416624] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.416772] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.416914] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.417083] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.417256] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.417410] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.417553] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.417694] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.417839] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.auth_section = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.417988] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.auth_type = password {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.418146] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.418316] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.certfile = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.418496] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.collect_timing = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.418689] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.endpoint_type = public {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.418874] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.insecure = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.419072] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.keyfile = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.419242] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.region_name = RegionOne {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.419390] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.split_loggers = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.419532] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] nova.timeout = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.419679] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.auth_section = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.419830] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.auth_type = password {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.420014] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.420173] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.certfile = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.420319] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.collect_timing = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.420470] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.endpoint_type = public {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.420612] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.insecure = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.420749] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.keyfile = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.420886] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.region_name = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.421037] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.split_loggers = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.421181] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] placement.timeout = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.421329] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.auth_section = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.421470] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.auth_type = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.421607] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.cafile = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.421743] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.certfile = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.421884] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.collect_timing = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.422041] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.connect_retries = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.422208] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.connect_retry_delay = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.422345] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.enable_notifications = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.422476] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.endpoint_override = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.422619] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.insecure = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.422757] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.interface = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.422893] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.keyfile = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.423060] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.max_version = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.423223] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.min_version = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.423363] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.region_name = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.423502] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.retriable_status_codes = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.423640] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.service_name = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.423776] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.service_type = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.423921] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.split_loggers = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.424071] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.status_code_retries = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.424213] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.status_code_retry_delay = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.424351] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.timeout = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.424490] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.valid_interfaces = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.424626] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ironic.version = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.424772] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] cli_script.dry_run = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.424934] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.425075] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.425221] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.425361] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.425498] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.425637] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.425775] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.425916] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.426062] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.426215] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.426353] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.426499] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.426645] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.426789] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.426928] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.427085] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.427281] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.427358] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.427521] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.427635] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.427775] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.427944] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.428061] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.428267] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.428350] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.428481] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.428603] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.428767] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.428864] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.429010] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.429152] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.ssl = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.429300] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.429444] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.429582] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.429724] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.429867] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.430049] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.430209] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_notifications.driver = [] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.430354] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_notifications.retry = -1 {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.430509] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.430651] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.430764] env[69238]: DEBUG oslo_service.backend.eventlet.service [None req-6a392c66-5172-41c1-8b98-66235ebba2e1 None None] ******************************************************************************** {{(pid=69238) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 628.431757] env[69238]: DEBUG neutron.agent.securitygroups_rpc [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Init firewall settings (driver=nsxv3) {{(pid=69238) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 628.433169] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69238) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 628.433433] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] RPC agent_id: nsxm-l-01a.corp.local [ 628.435787] env[69238]: DEBUG dogpile.cache.region [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.435910] env[69238]: DEBUG dogpile.lock [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.436027] env[69238]: DEBUG dogpile.lock [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.436131] env[69238]: DEBUG dogpile.lock [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.436230] env[69238]: DEBUG dogpile.cache.region [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.436321] env[69238]: DEBUG dogpile.lock [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.436445] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.465371] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Session token - acquiring [ 628.466983] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.467161] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.467272] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.467683] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.479453] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.756744] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 628.780799] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.780945] env[69238]: DEBUG dogpile.cache.region [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Cache value generated in 0.344 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 628.781078] env[69238]: DEBUG dogpile.lock [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.781191] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Activating Policy API Provider. [ 628.781393] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Looking for the default Infrastructure Rules. [ 628.852620] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Looking for the Default Layer3 Logged Drop Section. [ 628.868982] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 628.869480] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.869652] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.869754] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.870081] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.870434] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.386319] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.889146] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.391837] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Inventory metadata is going to be refreshed. [ 630.392229] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 631.184770] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.184992] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.185081] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.185403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.308598] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 631.309548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.310527] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 631.328555] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.328744] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.328862] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.329203] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.329348] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.329499] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 631.329617] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.329724] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 631.350513] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.350792] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.350880] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.351146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.351335] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.351485] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 631.372900] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.373177] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.373225] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.373517] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.373662] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.373842] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 631.393401] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.393813] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.393813] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.393952] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.394124] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.394299] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 631.394440] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.394550] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 631.413937] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.414173] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.414278] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.414532] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.414661] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.414808] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 631.414916] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.415033] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 631.436309] env[69238]: DEBUG networking_nsxv3.common.locking [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.436635] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.436713] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.437058] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.437281] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.437542] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 631.437686] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.437807] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Inventory metadata have been refreshed. [ 631.437965] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Dryrun:True. Metadata refresh completed. [ 631.438151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Releasing lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.440809] env[69238]: INFO neutron.agent.agent_extensions_manager [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Loaded agent extensions: [] [ 631.441764] env[69238]: DEBUG neutron_lib.callbacks.manager [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69238) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 631.506863] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent RPC Daemon Started! [ 631.507097] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent loop - iteration:0 started [ 631.507097] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent out of sync with plugin! [ 636.441829] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 636.442262] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 641.443148] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 641.443574] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 645.900271] env[69238]: INFO networking_nsxv3.common.synchronization [None req-7371df1a-8993-4bb5-aa48-6619f5919840 demo admin] Enqueued Resource ID: 19c10c7e-eea1-4bad-8021-a261b90c46ac with Priority: HIGHEST for action security_group_rules [ 645.900774] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c10c7e-eea1-4bad-8021-a261b90c46ac with Priority: HIGHEST for action security_group_rules [ 645.901181] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c10c7e-eea1-4bad-8021-a261b90c46ac taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.901300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c10c7e-eea1-4bad-8021-a261b90c46ac" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.901300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c10c7e-eea1-4bad-8021-a261b90c46ac" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.901669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c10c7e-eea1-4bad-8021-a261b90c46ac" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.901757] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c10c7e-eea1-4bad-8021-a261b90c46ac',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.421861] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.422158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.422158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.422305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.422453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.422542] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c10c7e-eea1-4bad-8021-a261b90c46ac already deleted. [ 646.422625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c10c7e-eea1-4bad-8021-a261b90c46ac" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.902482] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 650.902873] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 655.904288] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 655.904288] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 660.905609] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 660.906059] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 661.444646] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.444882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.444882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.445083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.445314] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.947753] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.450167] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.952742] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 662.953140] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 663.804058] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.804058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.804058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.804406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.814865] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 663.815747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.816701] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 663.834155] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.834339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.834381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.834659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.834786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.834935] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 663.835042] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 663.835134] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 663.857987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.858220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.858220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.858398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.858527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.858640] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 663.881447] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.881738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.881738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.881860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.881921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.882047] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 663.903113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.903369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.903369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.903674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.903674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.903822] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 663.903822] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 663.903822] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 663.923512] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.923831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.923831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.924038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.924094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.924201] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 663.924270] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 663.924346] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 663.946313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.946590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.946590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.946754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.946868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.946992] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 663.947079] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 663.947132] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 663.947200] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 663.947275] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 663.947329] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 663.947385] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 663.947642] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 663.947703] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 663.947770] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 663.970819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.971205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.971205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.971278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.971422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.971560] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 663.995795] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.996094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.996094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.996328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.996328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.030199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.907256] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 665.907748] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 670.908412] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 670.908695] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 674.743584] env[69238]: INFO networking_nsxv3.common.synchronization [None req-3bd468de-e261-43d3-9322-6b015b25c3ec None None] Enqueued Resource ID: 7b536b9a-e6f2-4549-9a50-a857d45c4b2f with Priority: HIGHEST for action port [ 674.743584] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b536b9a-e6f2-4549-9a50-a857d45c4b2f with Priority: HIGHEST for action port [ 674.743584] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b536b9a-e6f2-4549-9a50-a857d45c4b2f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.743584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b536b9a-e6f2-4549-9a50-a857d45c4b2f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.743584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b536b9a-e6f2-4549-9a50-a857d45c4b2f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.743584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b536b9a-e6f2-4549-9a50-a857d45c4b2f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.743584] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b536b9a-e6f2-4549-9a50-a857d45c4b2f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.249425] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b536b9a-e6f2-4549-9a50-a857d45c4b2f [ 675.249839] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.249839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.250107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.250107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.250200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.250864] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b536b9a-e6f2-4549-9a50-a857d45c4b2f already deleted. [ 675.250864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b536b9a-e6f2-4549-9a50-a857d45c4b2f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.842809] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9ad4b0d4-d295-4820-b290-74016a06803e None None] Enqueued Resource ID: df25106f-e6f2-4cb5-92f5-a0f9f48c8539 with Priority: HIGHEST for action port [ 676.842809] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df25106f-e6f2-4cb5-92f5-a0f9f48c8539 with Priority: HIGHEST for action port [ 676.842809] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-df25106f-e6f2-4cb5-92f5-a0f9f48c8539 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.842809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df25106f-e6f2-4cb5-92f5-a0f9f48c8539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.842809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df25106f-e6f2-4cb5-92f5-a0f9f48c8539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.844122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df25106f-e6f2-4cb5-92f5-a0f9f48c8539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.844247] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df25106f-e6f2-4cb5-92f5-a0f9f48c8539',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.116399] env[69238]: INFO networking_nsxv3.common.synchronization [None req-a08743c3-4d06-4836-87e2-c79ac67c8b68 None None] Enqueued Resource ID: 4abfb63d-9517-4e5a-9858-7b5c9fc40db4 with Priority: HIGHEST for action port [ 677.116399] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4abfb63d-9517-4e5a-9858-7b5c9fc40db4 with Priority: HIGHEST for action port [ 677.116399] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4abfb63d-9517-4e5a-9858-7b5c9fc40db4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.116399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4abfb63d-9517-4e5a-9858-7b5c9fc40db4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.116399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4abfb63d-9517-4e5a-9858-7b5c9fc40db4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.116399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4abfb63d-9517-4e5a-9858-7b5c9fc40db4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.116399] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4abfb63d-9517-4e5a-9858-7b5c9fc40db4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.348828] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df25106f-e6f2-4cb5-92f5-a0f9f48c8539 [ 677.349361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.351100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.351100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.351100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.351100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.351100] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df25106f-e6f2-4cb5-92f5-a0f9f48c8539 already deleted. [ 677.351100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df25106f-e6f2-4cb5-92f5-a0f9f48c8539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.619818] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4abfb63d-9517-4e5a-9858-7b5c9fc40db4 [ 677.620714] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.620714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.620714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.620714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.620714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.620714] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4abfb63d-9517-4e5a-9858-7b5c9fc40db4 already deleted. [ 677.620714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4abfb63d-9517-4e5a-9858-7b5c9fc40db4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.106353] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0fdc76e6-da57-4c4f-b47d-8eb10757bfe3 None None] Enqueued Resource ID: 800adc5e-d1c0-4709-a516-581de185899f with Priority: HIGHEST for action port [ 678.106598] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 800adc5e-d1c0-4709-a516-581de185899f with Priority: HIGHEST for action port [ 678.107241] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-800adc5e-d1c0-4709-a516-581de185899f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.107374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-800adc5e-d1c0-4709-a516-581de185899f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.107449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-800adc5e-d1c0-4709-a516-581de185899f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.107695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-800adc5e-d1c0-4709-a516-581de185899f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.107775] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('800adc5e-d1c0-4709-a516-581de185899f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.612516] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 800adc5e-d1c0-4709-a516-581de185899f [ 678.612919] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.613288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.613359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.613602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.613692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.613788] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:800adc5e-d1c0-4709-a516-581de185899f already deleted. [ 678.613866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-800adc5e-d1c0-4709-a516-581de185899f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.891393] env[69238]: INFO networking_nsxv3.common.synchronization [None req-ee64372f-7fcd-43f8-af4e-58d4cbd1fb77 None None] Enqueued Resource ID: efa021c0-00e7-40f8-9d4d-de774edd451d with Priority: HIGHEST for action port [ 678.891541] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efa021c0-00e7-40f8-9d4d-de774edd451d with Priority: HIGHEST for action port [ 678.892144] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-efa021c0-00e7-40f8-9d4d-de774edd451d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.892259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efa021c0-00e7-40f8-9d4d-de774edd451d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.892323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efa021c0-00e7-40f8-9d4d-de774edd451d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.892567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efa021c0-00e7-40f8-9d4d-de774edd451d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.892644] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efa021c0-00e7-40f8-9d4d-de774edd451d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.151236] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5392c46c-1965-4a43-a2ac-8a635260eb81 None None] Enqueued Resource ID: d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db with Priority: HIGHEST for action port [ 679.151457] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db with Priority: HIGHEST for action port [ 679.152809] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.152809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.152809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.152809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.152809] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.331918] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0004db68-3b1b-42fb-acbf-db97072cb91f None None] Enqueued Resource ID: 749359f3-0eea-4f30-9ef9-bcbe926bad41 with Priority: HIGHEST for action port [ 679.331918] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 749359f3-0eea-4f30-9ef9-bcbe926bad41 with Priority: HIGHEST for action port [ 679.332494] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-749359f3-0eea-4f30-9ef9-bcbe926bad41 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.332616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-749359f3-0eea-4f30-9ef9-bcbe926bad41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.332678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-749359f3-0eea-4f30-9ef9-bcbe926bad41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.332931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-749359f3-0eea-4f30-9ef9-bcbe926bad41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.335031] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('749359f3-0eea-4f30-9ef9-bcbe926bad41',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.398790] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efa021c0-00e7-40f8-9d4d-de774edd451d [ 679.398790] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.398790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.398790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.398790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.398790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.398790] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efa021c0-00e7-40f8-9d4d-de774edd451d already deleted. [ 679.398790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efa021c0-00e7-40f8-9d4d-de774edd451d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.655922] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db [ 679.655922] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.655922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.655922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.655922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.656353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.656353] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db already deleted. [ 679.656353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d08111d8-7e5d-4fa5-9cb9-c0e5fabaa7db" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.838519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 749359f3-0eea-4f30-9ef9-bcbe926bad41 [ 679.838519] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.838519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.838519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.838723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.838723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.838796] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:749359f3-0eea-4f30-9ef9-bcbe926bad41 already deleted. [ 679.838880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-749359f3-0eea-4f30-9ef9-bcbe926bad41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.184024] env[69238]: INFO networking_nsxv3.common.synchronization [None req-34a72740-323d-4e58-a135-d544308c9187 None None] Enqueued Resource ID: 76b19cbb-6ce4-4115-be60-42b38bdc6829 with Priority: HIGHEST for action port [ 680.184024] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76b19cbb-6ce4-4115-be60-42b38bdc6829 with Priority: HIGHEST for action port [ 680.184024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-76b19cbb-6ce4-4115-be60-42b38bdc6829 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.184024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76b19cbb-6ce4-4115-be60-42b38bdc6829" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.184024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76b19cbb-6ce4-4115-be60-42b38bdc6829" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.184024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76b19cbb-6ce4-4115-be60-42b38bdc6829" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.184024] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76b19cbb-6ce4-4115-be60-42b38bdc6829',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.685325] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76b19cbb-6ce4-4115-be60-42b38bdc6829 [ 680.685735] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.686052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.686222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.686510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.686695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.686868] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76b19cbb-6ce4-4115-be60-42b38bdc6829 already deleted. [ 680.687057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76b19cbb-6ce4-4115-be60-42b38bdc6829" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.277893] env[69238]: INFO networking_nsxv3.common.synchronization [None req-3945b020-f202-4513-aef7-b7195806008c None None] Enqueued Resource ID: f37e8f8a-6207-43b9-8caf-9d03d171fdce with Priority: HIGHEST for action port [ 681.277893] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37e8f8a-6207-43b9-8caf-9d03d171fdce with Priority: HIGHEST for action port [ 681.277893] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f37e8f8a-6207-43b9-8caf-9d03d171fdce taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.277893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f37e8f8a-6207-43b9-8caf-9d03d171fdce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.277893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f37e8f8a-6207-43b9-8caf-9d03d171fdce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.277893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f37e8f8a-6207-43b9-8caf-9d03d171fdce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.277893] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f37e8f8a-6207-43b9-8caf-9d03d171fdce',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.557033] env[69238]: INFO networking_nsxv3.common.synchronization [None req-30c0828a-454c-4b2d-b1b7-ab71ac067be0 None None] Enqueued Resource ID: bfab6438-f8ae-4295-9b93-bcd73a6dbe82 with Priority: HIGHEST for action port [ 681.557033] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfab6438-f8ae-4295-9b93-bcd73a6dbe82 with Priority: HIGHEST for action port [ 681.557033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfab6438-f8ae-4295-9b93-bcd73a6dbe82 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.557033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfab6438-f8ae-4295-9b93-bcd73a6dbe82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.557033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfab6438-f8ae-4295-9b93-bcd73a6dbe82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.557911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfab6438-f8ae-4295-9b93-bcd73a6dbe82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.558355] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfab6438-f8ae-4295-9b93-bcd73a6dbe82',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.787147] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f37e8f8a-6207-43b9-8caf-9d03d171fdce [ 681.787147] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.787147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.787147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.787147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.787147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.787147] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f37e8f8a-6207-43b9-8caf-9d03d171fdce already deleted. [ 681.787147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f37e8f8a-6207-43b9-8caf-9d03d171fdce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.061418] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfab6438-f8ae-4295-9b93-bcd73a6dbe82 [ 682.061655] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.061793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.061865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.062096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.062189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.062286] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfab6438-f8ae-4295-9b93-bcd73a6dbe82 already deleted. [ 682.062368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfab6438-f8ae-4295-9b93-bcd73a6dbe82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.070559] env[69238]: INFO networking_nsxv3.common.synchronization [None req-59ce0865-a4fa-4736-a9c4-5a8a3f091c05 None None] Enqueued Resource ID: eb53a6fb-21b6-4918-a3e6-3596d24bcfaa with Priority: HIGHEST for action port [ 682.070813] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb53a6fb-21b6-4918-a3e6-3596d24bcfaa with Priority: HIGHEST for action port [ 682.071409] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb53a6fb-21b6-4918-a3e6-3596d24bcfaa taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.071529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb53a6fb-21b6-4918-a3e6-3596d24bcfaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.072053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb53a6fb-21b6-4918-a3e6-3596d24bcfaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.072053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb53a6fb-21b6-4918-a3e6-3596d24bcfaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.072053] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb53a6fb-21b6-4918-a3e6-3596d24bcfaa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.575426] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb53a6fb-21b6-4918-a3e6-3596d24bcfaa [ 682.575684] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.577424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.578168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.578168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.578168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.578168] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb53a6fb-21b6-4918-a3e6-3596d24bcfaa already deleted. [ 682.578168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb53a6fb-21b6-4918-a3e6-3596d24bcfaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.636884] env[69238]: INFO networking_nsxv3.common.synchronization [None req-362b7c93-580c-4dac-894c-a60b46afc91d None None] Enqueued Resource ID: 1b9b7107-8c47-4e9f-a7a1-da200a6e7636 with Priority: HIGHEST for action port [ 682.637150] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b9b7107-8c47-4e9f-a7a1-da200a6e7636 with Priority: HIGHEST for action port [ 682.639173] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b9b7107-8c47-4e9f-a7a1-da200a6e7636 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.639173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b9b7107-8c47-4e9f-a7a1-da200a6e7636" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.639173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b9b7107-8c47-4e9f-a7a1-da200a6e7636" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.643429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b9b7107-8c47-4e9f-a7a1-da200a6e7636" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.643429] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b9b7107-8c47-4e9f-a7a1-da200a6e7636',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.142606] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b9b7107-8c47-4e9f-a7a1-da200a6e7636 [ 683.142852] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.142991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.143079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.143356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.143411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.143612] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b9b7107-8c47-4e9f-a7a1-da200a6e7636 already deleted. [ 683.143612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b9b7107-8c47-4e9f-a7a1-da200a6e7636" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.072424] env[69238]: INFO networking_nsxv3.common.synchronization [None req-13cce39a-7296-46d1-babe-0f70b4e8d3c9 None None] Enqueued Resource ID: 0de8286c-6bdc-47aa-a1dd-e500a6fb5d48 with Priority: HIGHEST for action port [ 684.072424] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0de8286c-6bdc-47aa-a1dd-e500a6fb5d48 with Priority: HIGHEST for action port [ 684.072424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0de8286c-6bdc-47aa-a1dd-e500a6fb5d48 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.072840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0de8286c-6bdc-47aa-a1dd-e500a6fb5d48" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.072840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0de8286c-6bdc-47aa-a1dd-e500a6fb5d48" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.072895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0de8286c-6bdc-47aa-a1dd-e500a6fb5d48" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.072928] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de8286c-6bdc-47aa-a1dd-e500a6fb5d48',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.578495] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0de8286c-6bdc-47aa-a1dd-e500a6fb5d48 [ 684.578495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.578495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.578495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.578495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.578495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.578495] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0de8286c-6bdc-47aa-a1dd-e500a6fb5d48 already deleted. [ 684.578495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0de8286c-6bdc-47aa-a1dd-e500a6fb5d48" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.180397] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5daea787-0987-484b-8818-7cd9426a3c33 None None] Enqueued Resource ID: 03f83ad1-88c5-47be-8ef3-a1621da758ed with Priority: HIGHEST for action port [ 685.180684] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f83ad1-88c5-47be-8ef3-a1621da758ed with Priority: HIGHEST for action port [ 685.181343] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f83ad1-88c5-47be-8ef3-a1621da758ed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.181405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f83ad1-88c5-47be-8ef3-a1621da758ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.183024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f83ad1-88c5-47be-8ef3-a1621da758ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.185270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f83ad1-88c5-47be-8ef3-a1621da758ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.185270] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f83ad1-88c5-47be-8ef3-a1621da758ed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.505885] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5494860d-008b-47f2-ae2b-d83015b00f06 None None] Enqueued Resource ID: 936a559c-5974-4e20-a894-60aab6356398 with Priority: HIGHEST for action port [ 685.505988] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936a559c-5974-4e20-a894-60aab6356398 with Priority: HIGHEST for action port [ 685.506546] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-936a559c-5974-4e20-a894-60aab6356398 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.506711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-936a559c-5974-4e20-a894-60aab6356398" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.506766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-936a559c-5974-4e20-a894-60aab6356398" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.506990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-936a559c-5974-4e20-a894-60aab6356398" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.507081] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936a559c-5974-4e20-a894-60aab6356398',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.688156] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03f83ad1-88c5-47be-8ef3-a1621da758ed [ 685.688298] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.688434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.690315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.691030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.691030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.691030] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03f83ad1-88c5-47be-8ef3-a1621da758ed already deleted. [ 685.691030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f83ad1-88c5-47be-8ef3-a1621da758ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.009864] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 936a559c-5974-4e20-a894-60aab6356398 [ 686.010192] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.010331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.010449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.010692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.010692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.010794] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:936a559c-5974-4e20-a894-60aab6356398 already deleted. [ 686.010866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-936a559c-5974-4e20-a894-60aab6356398" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.838028] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d6af3c2f-453f-43c9-a346-7579a2b177fb None None] Enqueued Resource ID: 8e5aa591-c0e0-41ce-90b3-e19070d8e43d with Priority: HIGHEST for action port [ 686.838676] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5aa591-c0e0-41ce-90b3-e19070d8e43d with Priority: HIGHEST for action port [ 686.840929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e5aa591-c0e0-41ce-90b3-e19070d8e43d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.840929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e5aa591-c0e0-41ce-90b3-e19070d8e43d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.840929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e5aa591-c0e0-41ce-90b3-e19070d8e43d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.840929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e5aa591-c0e0-41ce-90b3-e19070d8e43d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.840929] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e5aa591-c0e0-41ce-90b3-e19070d8e43d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.850841] env[69238]: INFO networking_nsxv3.common.synchronization [None req-7de55f97-3abe-4504-88aa-1042fd409dd8 None None] Enqueued Resource ID: 833c64ce-9967-4db2-a251-9a521c5ababd with Priority: HIGHEST for action port [ 686.851416] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833c64ce-9967-4db2-a251-9a521c5ababd with Priority: HIGHEST for action port [ 686.853298] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-833c64ce-9967-4db2-a251-9a521c5ababd taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.853447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-833c64ce-9967-4db2-a251-9a521c5ababd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.853524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-833c64ce-9967-4db2-a251-9a521c5ababd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.853768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-833c64ce-9967-4db2-a251-9a521c5ababd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.853851] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('833c64ce-9967-4db2-a251-9a521c5ababd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.344394] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e5aa591-c0e0-41ce-90b3-e19070d8e43d [ 687.346431] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.348077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.348217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.348425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.348546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.348657] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e5aa591-c0e0-41ce-90b3-e19070d8e43d already deleted. [ 687.348758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e5aa591-c0e0-41ce-90b3-e19070d8e43d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.357291] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 833c64ce-9967-4db2-a251-9a521c5ababd [ 687.357291] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.357291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.357291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.357291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.357567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.357567] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:833c64ce-9967-4db2-a251-9a521c5ababd already deleted. [ 687.357567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-833c64ce-9967-4db2-a251-9a521c5ababd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.943596] env[69238]: INFO networking_nsxv3.common.synchronization [None req-00adf75e-01f0-4e6b-b0c1-3c5e07051a4c None None] Enqueued Resource ID: b8b3a27c-c2e2-48b5-9eed-5deed5160619 with Priority: HIGHEST for action port [ 687.944106] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b3a27c-c2e2-48b5-9eed-5deed5160619 with Priority: HIGHEST for action port [ 687.944750] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8b3a27c-c2e2-48b5-9eed-5deed5160619 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.944947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8b3a27c-c2e2-48b5-9eed-5deed5160619" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.945030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8b3a27c-c2e2-48b5-9eed-5deed5160619" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.945262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8b3a27c-c2e2-48b5-9eed-5deed5160619" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.945314] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8b3a27c-c2e2-48b5-9eed-5deed5160619',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.148064] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d0e15204-f752-4b18-9492-24600a926af6 None None] Enqueued Resource ID: 68ace1d1-242f-455a-b9b0-2d48527aa576 with Priority: HIGHEST for action port [ 688.148319] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ace1d1-242f-455a-b9b0-2d48527aa576 with Priority: HIGHEST for action port [ 688.149160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-68ace1d1-242f-455a-b9b0-2d48527aa576 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.149160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68ace1d1-242f-455a-b9b0-2d48527aa576" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.149160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68ace1d1-242f-455a-b9b0-2d48527aa576" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.149422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68ace1d1-242f-455a-b9b0-2d48527aa576" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.149422] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68ace1d1-242f-455a-b9b0-2d48527aa576',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.449712] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8b3a27c-c2e2-48b5-9eed-5deed5160619 [ 688.449913] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.450262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.450262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.450358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.450458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.451585] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8b3a27c-c2e2-48b5-9eed-5deed5160619 already deleted. [ 688.451585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8b3a27c-c2e2-48b5-9eed-5deed5160619" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.655254] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68ace1d1-242f-455a-b9b0-2d48527aa576 [ 688.656041] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.656456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.656848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.657134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.657474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.657474] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68ace1d1-242f-455a-b9b0-2d48527aa576 already deleted. [ 688.657474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68ace1d1-242f-455a-b9b0-2d48527aa576" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.696130] env[69238]: INFO networking_nsxv3.common.synchronization [req-e3145a0a-716b-4fac-bc15-7e3a3ec657ca req-ef4d364d-e9c5-464f-961d-483f00a67d64 tempest-FloatingIPsAssociationNegativeTestJSON-2103775561 tempest-FloatingIPsAssociationNegativeTestJSON-2103775561-project-member] Enqueued Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_members [ 688.696130] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_members [ 688.696130] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.697418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.697418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.697418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.697777] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.698008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.698115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.698319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.698448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.698661] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.201772] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.202136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.202136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.202714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.202714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.202714] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.202714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.202714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.204214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.204214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.204214] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2d26f8-cf66-400c-8b21-810887d32724 already deleted. [ 689.204214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.165402] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.166387] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-190" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.166387] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-190" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.167291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-190" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.167624] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.168851] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.169020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.169412] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.169581] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.169904] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.170034] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.170149] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.170272] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.170389] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.170501] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.170637] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.195063] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.195063] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.195063] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.195063] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-190" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.195063] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.195063] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.195063] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.195063] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.195063] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.307877] env[69238]: INFO networking_nsxv3.common.synchronization [req-efadad35-b0be-40f9-b6e5-e4dcf5d30e51 req-73de4d50-3d28-47b6-80f5-182ec10493d5 tempest-DeleteServersAdminTestJSON-638818905 tempest-DeleteServersAdminTestJSON-638818905-project-member] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 690.308408] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 690.308686] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.308813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.308895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.309194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.309420] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.309420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.309575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.309622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.309670] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.309767] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.698403] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.698626] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.698626] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.699548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.699548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.699548] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c not found, creating... [ 690.700201] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.700734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.700734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.700842] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.701168] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.701629] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.701793] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.701911] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.702587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.702739] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.702893] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c is going to be created. [ 690.735333] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.735333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.735333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.735333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.735333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.735333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.812293] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.812447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.812537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.812732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.812819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.813033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.813146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.813243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.813408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.813442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.815811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 already deleted. [ 690.815811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.015310] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d5b6c7e9-b02a-4089-93e7-cc7f5883b3a5 None None] Enqueued Resource ID: 465243de-e6b2-4a4d-a494-706020fecca6 with Priority: HIGHEST for action port [ 691.017205] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465243de-e6b2-4a4d-a494-706020fecca6 with Priority: HIGHEST for action port [ 691.018791] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-465243de-e6b2-4a4d-a494-706020fecca6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.018791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-465243de-e6b2-4a4d-a494-706020fecca6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.018791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-465243de-e6b2-4a4d-a494-706020fecca6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.018791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-465243de-e6b2-4a4d-a494-706020fecca6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.018791] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465243de-e6b2-4a4d-a494-706020fecca6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.281162] env[69238]: INFO networking_nsxv3.common.synchronization [None req-208eb82b-9939-442b-96d1-469444f255b2 tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 691.281685] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 691.282190] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.282320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.282385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.282640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.282722] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.524780] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 465243de-e6b2-4a4d-a494-706020fecca6 [ 691.525237] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.525237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.525706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.525706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.525706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.525706] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:465243de-e6b2-4a4d-a494-706020fecca6 already deleted. [ 691.526219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-465243de-e6b2-4a4d-a494-706020fecca6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.552678] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.552833] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.552874] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.553247] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.553534] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.553690] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.553807] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.554878] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.555095] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.555359] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.555753] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.555753] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.555753] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.555753] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.555904] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.555962] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.581730] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.581730] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 691.581730] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.581730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.581730] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-42769435-fd79-4b45-a970-b2df4d058274 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.581730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.581730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.581730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.581730] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42769435-fd79-4b45-a970-b2df4d058274',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.812224] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.812224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.812224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.812224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.812224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.812224] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c already deleted. [ 691.812224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.845824] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b453b967-f8cc-447d-81dc-a304378d5cd6 tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 691.845824] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 691.845824] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.845824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.845824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.846935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.847155] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.036038] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c1175666-1c15-426d-a403-69f40bca6ffb None None] Enqueued Resource ID: 6871f332-a7f9-41e3-adf1-6725db87d5d2 with Priority: HIGHEST for action port [ 692.036038] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6871f332-a7f9-41e3-adf1-6725db87d5d2 with Priority: HIGHEST for action port [ 692.036038] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6871f332-a7f9-41e3-adf1-6725db87d5d2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.036038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6871f332-a7f9-41e3-adf1-6725db87d5d2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.036038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6871f332-a7f9-41e3-adf1-6725db87d5d2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.036038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6871f332-a7f9-41e3-adf1-6725db87d5d2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.036038] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6871f332-a7f9-41e3-adf1-6725db87d5d2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.085641] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.085641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.085641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.085641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.085641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.085641] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 42769435-fd79-4b45-a970-b2df4d058274 not found, creating... [ 692.085992] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.085992] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.085992] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.086197] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.086350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.086626] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.086790] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.086922] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.087127] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.087283] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.087986] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 42769435-fd79-4b45-a970-b2df4d058274 is going to be created. [ 692.109802] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.110321] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.110321] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.110431] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.110629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.110853] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.120200] env[69238]: INFO networking_nsxv3.common.synchronization [req-e3145a0a-716b-4fac-bc15-7e3a3ec657ca req-82f9c697-ea6e-4908-a54c-abd3f941d5b5 service nova] Enqueued Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_rules [ 692.120200] env[69238]: INFO networking_nsxv3.common.synchronization [req-e3145a0a-716b-4fac-bc15-7e3a3ec657ca req-82f9c697-ea6e-4908-a54c-abd3f941d5b5 service nova] Enqueued Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_members [ 692.120200] env[69238]: INFO networking_nsxv3.common.synchronization [req-e3145a0a-716b-4fac-bc15-7e3a3ec657ca req-82f9c697-ea6e-4908-a54c-abd3f941d5b5 service nova] Enqueued Resource ID: 3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c with Priority: HIGHEST for action port [ 692.124127] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_rules [ 692.124486] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_members [ 692.124486] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c with Priority: HIGHEST for action port [ 692.124990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.125130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.125195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.125506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.125631] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.131644] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.131644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.131644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.131791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.132429] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.132429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.132429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.132429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.132429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.132692] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.135049] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.135106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.135175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.135375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.135410] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.373951] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.374355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.374355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.374546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.374613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.375712] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c already deleted. [ 692.375712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.539502] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6871f332-a7f9-41e3-adf1-6725db87d5d2 [ 692.539797] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.539797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.539945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.540331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.540331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.540331] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6871f332-a7f9-41e3-adf1-6725db87d5d2 already deleted. [ 692.540331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6871f332-a7f9-41e3-adf1-6725db87d5d2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.637495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.637618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.658526] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.663498] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c with status ACTIVE [ 692.663498] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.663498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.663498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.663498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.663498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.663498] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.664226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.664226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.664226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.664226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.664226] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.664226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.664226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.664518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.664518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.664575] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c is going to be updated. [ 692.699198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.699340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.699407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.699606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.699736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.699898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf19e7a-d1e5-4fa0-831b-a08d472f2d7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.966856] env[69238]: INFO networking_nsxv3.common.synchronization [req-e6e51e86-ccfb-4fb9-9c1a-41dc8334bbe0 req-f7441fe0-707f-4e90-9e17-884690d402fa tempest-ServersAdminNegativeTestJSON-838199429 tempest-ServersAdminNegativeTestJSON-838199429-project-member] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 692.966856] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 692.966856] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.967138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.967138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.967909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.968091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.968199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.968259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.968407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.968487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.968577] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.160141] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.427890] env[69238]: INFO networking_nsxv3.common.synchronization [None req-80394c12-79e1-4761-8455-ee38a3411794 None None] Enqueued Resource ID: 48dc00e0-d9ad-4d77-ad99-e6c004f4808e with Priority: HIGHEST for action port [ 693.428103] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dc00e0-d9ad-4d77-ad99-e6c004f4808e with Priority: HIGHEST for action port [ 693.428756] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-48dc00e0-d9ad-4d77-ad99-e6c004f4808e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.429560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48dc00e0-d9ad-4d77-ad99-e6c004f4808e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.432193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48dc00e0-d9ad-4d77-ad99-e6c004f4808e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.432614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48dc00e0-d9ad-4d77-ad99-e6c004f4808e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.432687] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48dc00e0-d9ad-4d77-ad99-e6c004f4808e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.476310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.476310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.476310] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf already deleted. [ 693.476310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.640880] env[69238]: INFO networking_nsxv3.common.synchronization [req-efadad35-b0be-40f9-b6e5-e4dcf5d30e51 req-965c8fd4-d913-46c0-93ac-d9221287c0b5 service nova] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_rules [ 693.641157] env[69238]: INFO networking_nsxv3.common.synchronization [req-efadad35-b0be-40f9-b6e5-e4dcf5d30e51 req-965c8fd4-d913-46c0-93ac-d9221287c0b5 service nova] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 693.641203] env[69238]: INFO networking_nsxv3.common.synchronization [req-efadad35-b0be-40f9-b6e5-e4dcf5d30e51 req-965c8fd4-d913-46c0-93ac-d9221287c0b5 service nova] Enqueued Resource ID: 42769435-fd79-4b45-a970-b2df4d058274 with Priority: HIGHEST for action port [ 693.641762] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_rules [ 693.644166] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 693.644314] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42769435-fd79-4b45-a970-b2df4d058274 with Priority: HIGHEST for action port [ 693.644617] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.644743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.644807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.645077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.645159] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.646348] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.646528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.646698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.646841] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.646986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.647138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.647219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.647305] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.651335] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-42769435-fd79-4b45-a970-b2df4d058274 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.651481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.651545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.651723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.651878] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42769435-fd79-4b45-a970-b2df4d058274',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.662771] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.662925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.662980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.663209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.663311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.665018] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2d26f8-cf66-400c-8b21-810887d32724 is going to be created. [ 693.728729] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.728968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.729101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.729338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.730154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.732972] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9b0a4e9d-fedf-4472-9037-4f1b00e18e34 None None] Enqueued Resource ID: bd9d1f3c-d1b3-48d4-b6a1-57868dd65195 with Priority: HIGHEST for action port [ 693.733928] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9d1f3c-d1b3-48d4-b6a1-57868dd65195 with Priority: HIGHEST for action port [ 693.734707] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd9d1f3c-d1b3-48d4-b6a1-57868dd65195 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.734875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd9d1f3c-d1b3-48d4-b6a1-57868dd65195" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.734961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd9d1f3c-d1b3-48d4-b6a1-57868dd65195" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.735251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd9d1f3c-d1b3-48d4-b6a1-57868dd65195" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.735360] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd9d1f3c-d1b3-48d4-b6a1-57868dd65195',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.747696] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2d26f8-cf66-400c-8b21-810887d32724 in Status: UNINITIALIZED for 2s [ 693.868924] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.871084] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.871084] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.871084] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.871370] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.871587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.871714] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.871985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.872394] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.872394] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.872550] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.872617] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.872772] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.872848] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.873453] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.873453] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.892014] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.892205] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.892371] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.892575] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.892953] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.893139] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.893343] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.893853] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.893941] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e5576ed-ecc7-476b-9cfa-e7d363cfb348',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.934584] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48dc00e0-d9ad-4d77-ad99-e6c004f4808e [ 693.934963] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.935182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.935305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.935648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.935771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.935934] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48dc00e0-d9ad-4d77-ad99-e6c004f4808e already deleted. [ 693.936116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48dc00e0-d9ad-4d77-ad99-e6c004f4808e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.155188] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.155407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.155489] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.157063] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42769435-fd79-4b45-a970-b2df4d058274 with status ACTIVE [ 694.157063] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.157063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.157063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.157063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.158401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.158401] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.158401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.158401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.158401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.158401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.158401] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.158401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.159213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.160626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.160812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.160983] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42769435-fd79-4b45-a970-b2df4d058274 is going to be updated. [ 694.200544] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.200753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.200753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.200951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.201096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.201252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42769435-fd79-4b45-a970-b2df4d058274" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.241418] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd9d1f3c-d1b3-48d4-b6a1-57868dd65195 [ 694.242136] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.242136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.242136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.242136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.242379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.242379] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd9d1f3c-d1b3-48d4-b6a1-57868dd65195 already deleted. [ 694.242379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd9d1f3c-d1b3-48d4-b6a1-57868dd65195" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.397046] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.397046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.397046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.397046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.397377] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.397377] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 9e5576ed-ecc7-476b-9cfa-e7d363cfb348 not found, creating... [ 694.397999] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.397999] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.397999] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.398257] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.398365] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.398712] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.398990] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.403586] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.403805] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.403920] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.405021] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 9e5576ed-ecc7-476b-9cfa-e7d363cfb348 is going to be created. [ 694.432419] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.432643] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.432778] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.435719] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.435719] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.435719] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.666465] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.778544] env[69238]: INFO networking_nsxv3.common.synchronization [None req-a2a63ae0-2f48-4a6d-bc5d-74191dbedc06 None None] Enqueued Resource ID: c70293df-2934-41d5-a7d9-a8c5156497aa with Priority: HIGHEST for action port [ 694.778813] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70293df-2934-41d5-a7d9-a8c5156497aa with Priority: HIGHEST for action port [ 694.779448] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c70293df-2934-41d5-a7d9-a8c5156497aa taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.779572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c70293df-2934-41d5-a7d9-a8c5156497aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.779642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c70293df-2934-41d5-a7d9-a8c5156497aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.779912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c70293df-2934-41d5-a7d9-a8c5156497aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.779990] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c70293df-2934-41d5-a7d9-a8c5156497aa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.171564] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.171749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.171821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.172046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.172137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.172242] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be created. [ 695.233020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.233020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.233020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.233020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.233020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.247821] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: UNINITIALIZED for 2s [ 695.286542] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c70293df-2934-41d5-a7d9-a8c5156497aa [ 695.286542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.286646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.286646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.286853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.286947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.287054] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c70293df-2934-41d5-a7d9-a8c5156497aa already deleted. [ 695.287162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c70293df-2934-41d5-a7d9-a8c5156497aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.377858] env[69238]: INFO networking_nsxv3.common.synchronization [req-4897ea73-28e6-417f-a512-a36f99fdc285 req-62235780-6459-47a9-abf7-8327ecf45a3f tempest-AttachInterfacesV270Test-1276176338 tempest-AttachInterfacesV270Test-1276176338-project-member] Enqueued Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_members [ 695.377858] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_members [ 695.377858] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.377858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.377858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.378731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.378731] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.378731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.378731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.378731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.378731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.378919] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.672797] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d1691e81-8d2d-432b-87dd-4d90dd25a718 None None] Enqueued Resource ID: d89b68b9-3b3b-4c1f-bedf-9edf343a98a7 with Priority: HIGHEST for action port [ 695.673611] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89b68b9-3b3b-4c1f-bedf-9edf343a98a7 with Priority: HIGHEST for action port [ 695.674897] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d89b68b9-3b3b-4c1f-bedf-9edf343a98a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.675832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d89b68b9-3b3b-4c1f-bedf-9edf343a98a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.676138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d89b68b9-3b3b-4c1f-bedf-9edf343a98a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.676608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d89b68b9-3b3b-4c1f-bedf-9edf343a98a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.676766] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d89b68b9-3b3b-4c1f-bedf-9edf343a98a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.764489] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2d26f8-cf66-400c-8b21-810887d32724 in Status: SUCCESS [ 695.764651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.765476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.765767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.765992] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.766137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.766201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.766357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.766450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.766536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.766625] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.884341] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.884341] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.884341] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 already deleted. [ 695.884341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.179528] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d89b68b9-3b3b-4c1f-bedf-9edf343a98a7 [ 696.179528] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.180320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.180320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.180320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.180412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.180495] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d89b68b9-3b3b-4c1f-bedf-9edf343a98a7 already deleted. [ 696.180593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d89b68b9-3b3b-4c1f-bedf-9edf343a98a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.272885] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.272885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.272885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.272885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.273211] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.273423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.273544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.273797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.273961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.274066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.274298] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.274526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.275353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.275353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.275353] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.275353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.275353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.275353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.275353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.275621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.276226] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.285100] env[69238]: INFO networking_nsxv3.common.synchronization [req-e6e51e86-ccfb-4fb9-9c1a-41dc8334bbe0 req-e39e783d-9cf2-4820-9608-810c961583a1 service nova] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_rules [ 696.285291] env[69238]: INFO networking_nsxv3.common.synchronization [req-e6e51e86-ccfb-4fb9-9c1a-41dc8334bbe0 req-e39e783d-9cf2-4820-9608-810c961583a1 service nova] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 696.285423] env[69238]: INFO networking_nsxv3.common.synchronization [req-e6e51e86-ccfb-4fb9-9c1a-41dc8334bbe0 req-e39e783d-9cf2-4820-9608-810c961583a1 service nova] Enqueued Resource ID: 9e5576ed-ecc7-476b-9cfa-e7d363cfb348 with Priority: HIGHEST for action port [ 696.285654] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_rules [ 696.285779] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 696.285871] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5576ed-ecc7-476b-9cfa-e7d363cfb348 with Priority: HIGHEST for action port [ 696.286962] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.287129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.287196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.287457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.287551] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.288465] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.288524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.289461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.289660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.289819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.289935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.289983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.290139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.290222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.290312] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.291168] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.291276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.291339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.291490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.291814] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e5576ed-ecc7-476b-9cfa-e7d363cfb348',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.538306] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.538651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-59" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.538761] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-59" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.539467] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-59" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.539467] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.539896] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.539896] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.539986] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.540399] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.540651] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.540833] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.540964] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.541088] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.546038] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.546038] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.546038] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.568416] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.568416] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.568416] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.568591] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-59" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.569071] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.569417] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.569841] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.570291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.570409] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.779202] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e2d26f8-cf66-400c-8b21-810887d32724: rpc.has_security_group_logging(os_id): False [ 696.792902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.793132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.793246] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.797377] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e5576ed-ecc7-476b-9cfa-e7d363cfb348 with status ACTIVE [ 696.798475] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.798475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.798475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.798475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.798475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.798475] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.798475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.798475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.798836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.798836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.798891] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.798937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.799104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.799209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.799241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.799422] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e5576ed-ecc7-476b-9cfa-e7d363cfb348 is going to be updated. [ 696.802096] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.802096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.802096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.802096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.802322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.802352] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.802612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.802612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.802612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.802723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.803683] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.803683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.803683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.803683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.803683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.803683] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.803683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.803683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.804075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.804075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.804075] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2d26f8-cf66-400c-8b21-810887d32724 is going to be created. [ 696.838301] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.838454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.838523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.838773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.838916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.839096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e5576ed-ecc7-476b-9cfa-e7d363cfb348" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.906585] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.906804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.906804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.907025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.907966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.928308] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e2d26f8-cf66-400c-8b21-810887d32724 in Status: IN_PROGRESS for 2s [ 697.073231] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.074438] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.074438] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.074438] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.074438] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.074438] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 not found, creating... [ 697.074738] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.074738] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.074832] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.075064] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.078022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.078022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.078022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.078022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.078022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.078022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.078022] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 is going to be created. [ 697.116962] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.117351] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.117532] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.117769] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.118208] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.118292] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.266983] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: SUCCESS [ 697.267255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.267432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.267799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.268026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.268867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.268867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.268867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.268867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.268867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.269162] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.307186] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.775266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.775266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.775266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.775266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.775266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.776264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.776264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.776264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.776264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.776264] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.809274] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.809630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.809630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.809868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.809868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.809930] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be created. [ 697.842974] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.843337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.843527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.843758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.843947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.854756] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: UNINITIALIZED for 2s [ 697.922360] env[69238]: INFO networking_nsxv3.common.synchronization [req-4897ea73-28e6-417f-a512-a36f99fdc285 req-b8b5b61f-67c8-4651-86e5-7f03c23a8485 service nova] Enqueued Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_rules [ 697.922360] env[69238]: INFO networking_nsxv3.common.synchronization [req-4897ea73-28e6-417f-a512-a36f99fdc285 req-b8b5b61f-67c8-4651-86e5-7f03c23a8485 service nova] Enqueued Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_members [ 697.922360] env[69238]: INFO networking_nsxv3.common.synchronization [req-4897ea73-28e6-417f-a512-a36f99fdc285 req-b8b5b61f-67c8-4651-86e5-7f03c23a8485 service nova] Enqueued Resource ID: 05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 with Priority: HIGHEST for action port [ 697.922360] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_rules [ 697.922360] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_members [ 697.922360] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 with Priority: HIGHEST for action port [ 697.922360] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.923305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.923649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.924246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.929030] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.929030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.929030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.929030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.929030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.929030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.929030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.929030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.929030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.930125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.930125] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.930398] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.930549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.930604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.930766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.930842] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.073987] env[69238]: INFO networking_nsxv3.common.synchronization [req-188bbd3e-0c56-4932-a99d-2ac7853a1ee2 req-c43beef1-49ee-40b4-9854-0b64affb6511 tempest-ServerExternalEventsTest-1268933474 tempest-ServerExternalEventsTest-1268933474-project-member] Enqueued Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_members [ 698.073987] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_members [ 698.073987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.074566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.074686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.074977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.075173] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.075324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.075393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.075580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.075684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.075760] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.280542] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7: rpc.has_security_group_logging(os_id): False [ 698.305654] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.305733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.305804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.306121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.306405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.306954] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.306954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.306954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.306954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.307189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.311457] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.311730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.311730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.312037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.312126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.312336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.312439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.312498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.312685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.313941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.313941] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be created. [ 698.413327] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.413327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.413327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.413327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.413327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.428370] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: IN_PROGRESS for 2s [ 698.435190] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.435190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.439089] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.439089] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 with status ACTIVE [ 698.439089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.439089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.439089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.439089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.439869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.439869] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5 is going to be updated. [ 698.471898] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.475575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.475856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.476656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.477920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.477920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05f20e71-33dc-4dc9-8a7a-3f4ce0ecafa5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.559355] env[69238]: INFO networking_nsxv3.common.synchronization [None req-170ff98c-6f33-4913-b7bc-06b50e892376 tempest-VolumesAssistedSnapshotsTest-1717929212 tempest-VolumesAssistedSnapshotsTest-1717929212-project-member] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_rules [ 698.560026] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_rules [ 698.563087] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.563305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.563305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.563671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.563865] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.578572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.578749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.578975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.579032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.579134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.579302] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.579426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.579502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.580196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.580196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.580196] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd already deleted. [ 698.580196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.604336] env[69238]: INFO networking_nsxv3.common.synchronization [None req-680fe31c-072a-49be-ad17-f8a249a86946 None None] Enqueued Resource ID: 7c8635ed-1813-4d32-976b-8927db581030 with Priority: HIGHEST for action port [ 698.604336] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c8635ed-1813-4d32-976b-8927db581030 with Priority: HIGHEST for action port [ 698.604336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c8635ed-1813-4d32-976b-8927db581030 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.604336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c8635ed-1813-4d32-976b-8927db581030" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.604336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c8635ed-1813-4d32-976b-8927db581030" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.604336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c8635ed-1813-4d32-976b-8927db581030" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.604336] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c8635ed-1813-4d32-976b-8927db581030',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.882080] env[69238]: INFO networking_nsxv3.common.synchronization [None req-a08ce348-7683-4181-adcb-9287f494fa83 tempest-VolumesAssistedSnapshotsTest-1717929212 tempest-VolumesAssistedSnapshotsTest-1717929212-project-member] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_rules [ 698.885530] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_rules [ 698.885530] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.885530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.941910] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.943635] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e2d26f8-cf66-400c-8b21-810887d32724 in Status: SUCCESS [ 698.944937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.088881] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.088881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.088881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.088881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.088881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.088881] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf already deleted. [ 699.088881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.089228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.089259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.089349] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.112247] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c8635ed-1813-4d32-976b-8927db581030 [ 699.112247] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.112247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.112247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.112247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.112247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.112247] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c8635ed-1813-4d32-976b-8927db581030 already deleted. [ 699.112247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c8635ed-1813-4d32-976b-8927db581030" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.444059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.444059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.444059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.444059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.444059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.444059] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 is going to be created. [ 699.477113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.477425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.477530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.477975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.478913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.494723] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 in Status: UNINITIALIZED for 2s [ 699.618327] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.618566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.618662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.618883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.618978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.619117] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf already deleted. [ 699.619204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.867102] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: SUCCESS [ 699.867658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.867658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.867809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.867922] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.868055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.868122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.868287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.868455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.868455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.868579] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.957899] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.958913] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.958913] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.958913] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.963039] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.963039] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.963039] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.963039] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.963039] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.963039] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.963039] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.963039] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.963039] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.963039] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.963039] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.963039] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.986565] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.987337] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.988144] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.988291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.988633] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-3421717b-1633-4879-989f-7afa9f09dcaa taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.988814] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.988937] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.991101] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.991101] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3421717b-1633-4879-989f-7afa9f09dcaa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.069943] env[69238]: INFO networking_nsxv3.common.synchronization [None req-20efde2b-1631-43b3-ad3e-bbaa0813b8dc None None] Enqueued Resource ID: 4e037ac5-c513-4e29-8b3a-63427f0c00a1 with Priority: HIGHEST for action port [ 700.070482] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e037ac5-c513-4e29-8b3a-63427f0c00a1 with Priority: HIGHEST for action port [ 700.070982] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e037ac5-c513-4e29-8b3a-63427f0c00a1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.072637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e037ac5-c513-4e29-8b3a-63427f0c00a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.072637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e037ac5-c513-4e29-8b3a-63427f0c00a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.072966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e037ac5-c513-4e29-8b3a-63427f0c00a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.073289] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e037ac5-c513-4e29-8b3a-63427f0c00a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.374009] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.374009] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.374009] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.374009] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.374009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.374683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.374683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.374683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.374683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.374798] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.424097] env[69238]: INFO networking_nsxv3.common.synchronization [req-587fe5ce-2aaa-49dc-8962-2515c5707443 req-913491ba-6172-4a22-b522-8df78008b9d5 tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 700.424791] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 700.425202] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.425348] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.425459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.425676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.428103] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.428103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.428103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.428103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.428103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.428103] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.442222] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: SUCCESS [ 700.442467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.494149] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.496018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.502041] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.502041] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.502041] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.502041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 3421717b-1633-4879-989f-7afa9f09dcaa not found, creating... [ 700.502041] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.506540] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.506540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.506540] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 3421717b-1633-4879-989f-7afa9f09dcaa is going to be created. [ 700.513952] env[69238]: INFO networking_nsxv3.common.synchronization [None req-f2a00d76-80fa-4e87-ab13-3ae7b12d56d7 None None] Enqueued Resource ID: f7ec472d-7bc4-4347-8597-ebb9c7540703 with Priority: HIGHEST for action port [ 700.514243] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7ec472d-7bc4-4347-8597-ebb9c7540703 with Priority: HIGHEST for action port [ 700.517571] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7ec472d-7bc4-4347-8597-ebb9c7540703 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.517571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7ec472d-7bc4-4347-8597-ebb9c7540703" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.517571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7ec472d-7bc4-4347-8597-ebb9c7540703" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.517571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7ec472d-7bc4-4347-8597-ebb9c7540703" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.517571] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7ec472d-7bc4-4347-8597-ebb9c7540703',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.527997] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.529372] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.529674] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.530996] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.531290] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.531561] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.576358] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e037ac5-c513-4e29-8b3a-63427f0c00a1 [ 700.576934] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.577107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.577167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.577379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.577477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.577568] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e037ac5-c513-4e29-8b3a-63427f0c00a1 already deleted. [ 700.577646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e037ac5-c513-4e29-8b3a-63427f0c00a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.878266] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd8c2d89-8008-4f6a-97b2-32f45c842cdf: rpc.has_security_group_logging(os_id): False [ 700.901600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.901600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.901600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.901600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.901780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.901886] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.902039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.902110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.902269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.902345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.902582] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.902758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.902758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.902826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.903095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.903095] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.903207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.903297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.905037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.905037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.905037] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be created. [ 700.930986] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.931171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.931239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.931599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.931693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.931901] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.931995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.932066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.932216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.932453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.932453] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f already deleted. [ 700.932453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.980632] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.980632] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.980981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.980981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.981203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.998735] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: IN_PROGRESS for 2s [ 701.021939] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7ec472d-7bc4-4347-8597-ebb9c7540703 [ 701.022289] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.022289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.022413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.022589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.022665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.024810] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7ec472d-7bc4-4347-8597-ebb9c7540703 already deleted. [ 701.024810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7ec472d-7bc4-4347-8597-ebb9c7540703" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.308574] env[69238]: INFO networking_nsxv3.common.synchronization [None req-928e3a8d-3876-4f4e-b22c-05c09934d722 None None] Enqueued Resource ID: 9256d2c1-350e-465d-9b8e-600f1250db95 with Priority: HIGHEST for action port [ 701.308711] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9256d2c1-350e-465d-9b8e-600f1250db95 with Priority: HIGHEST for action port [ 701.309498] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9256d2c1-350e-465d-9b8e-600f1250db95 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.309498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9256d2c1-350e-465d-9b8e-600f1250db95" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.309498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9256d2c1-350e-465d-9b8e-600f1250db95" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.309793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9256d2c1-350e-465d-9b8e-600f1250db95" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.309850] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9256d2c1-350e-465d-9b8e-600f1250db95',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.510043] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 in Status: SUCCESS [ 701.510271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.510354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.510646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.510743] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.510919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.510919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.511055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.514321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.514321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.514321] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.814365] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9256d2c1-350e-465d-9b8e-600f1250db95 [ 701.814739] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.814739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.815751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.815992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.815992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.816129] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9256d2c1-350e-465d-9b8e-600f1250db95 already deleted. [ 701.816293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9256d2c1-350e-465d-9b8e-600f1250db95" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.002756] env[69238]: INFO networking_nsxv3.common.synchronization [req-188bbd3e-0c56-4932-a99d-2ac7853a1ee2 req-008983df-c723-41e4-9725-64058ef2dd60 service nova] Enqueued Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_rules [ 702.003148] env[69238]: INFO networking_nsxv3.common.synchronization [req-188bbd3e-0c56-4932-a99d-2ac7853a1ee2 req-008983df-c723-41e4-9725-64058ef2dd60 service nova] Enqueued Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_members [ 702.003385] env[69238]: INFO networking_nsxv3.common.synchronization [req-188bbd3e-0c56-4932-a99d-2ac7853a1ee2 req-008983df-c723-41e4-9725-64058ef2dd60 service nova] Enqueued Resource ID: 3421717b-1633-4879-989f-7afa9f09dcaa with Priority: HIGHEST for action port [ 702.004977] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_rules [ 702.004977] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_members [ 702.004977] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3421717b-1633-4879-989f-7afa9f09dcaa with Priority: HIGHEST for action port [ 702.005421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.005421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.005421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.007902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.007902] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.007902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.007902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.007902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.007902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.007902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.008374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.008374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.008374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.008374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.008374] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.009313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-3421717b-1633-4879-989f-7afa9f09dcaa taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.009438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.009438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.009560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.009633] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3421717b-1633-4879-989f-7afa9f09dcaa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.016883] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.017056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.017127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.017347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.017499] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.017605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.017666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.017810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.017888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.017970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.018128] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.018238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.018294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.018572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.018572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.018672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.018709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.018854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.018910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.018988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.019084] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.512118] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.512118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.512118] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.513155] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3421717b-1633-4879-989f-7afa9f09dcaa with status ACTIVE [ 702.513350] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.513984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.513984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.513984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.513984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.514192] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.514247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.514338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.514467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.514580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.514827] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.514941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.515023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.515196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.515281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.515367] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3421717b-1633-4879-989f-7afa9f09dcaa is going to be updated. [ 702.527740] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c36918-1cb3-48fc-9bfd-8e61ee964b49: rpc.has_security_group_logging(os_id): False [ 702.542650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.542650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.542650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.542650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.542650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.542650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3421717b-1633-4879-989f-7afa9f09dcaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.552764] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.552933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.552933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.554898] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.554898] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.554898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.555391] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.555391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.555391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.555391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.555655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.555655] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 is going to be created. [ 702.630216] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.630216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.630216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.630216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.630784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.664517] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 in Status: IN_PROGRESS for 2s [ 702.912880] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.913177] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.913177] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.913502] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.913770] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.913933] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.914102] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.914293] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.914440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.914744] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.914842] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.914942] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.917770] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.918009] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.918144] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.918327] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.943418] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.943856] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.943856] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.944080] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.944913] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-e199eac3-3b7c-4bc7-8608-eaea86437570 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.947702] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.947702] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.947702] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.947702] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e199eac3-3b7c-4bc7-8608-eaea86437570',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.019546] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: SUCCESS [ 703.019546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.019546] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.178858] env[69238]: INFO networking_nsxv3.common.synchronization [req-ceee7019-76ce-44e9-b1fc-2c4b5b661322 req-7369f83a-b80b-41d4-aee6-23206089127b tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 703.178858] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 703.178858] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.178858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.179102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.179336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.180376] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.180533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.180637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.180842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.180990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.181140] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.237840] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b67afbe8-a66b-41a0-bb49-8a59cb31c39d tempest-ServersWithSpecificFlavorTestJSON-1275212292 tempest-ServersWithSpecificFlavorTestJSON-1275212292-project-member] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 703.238900] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 703.238900] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.238900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.238900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.239224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.239266] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.450664] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.451221] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.451221] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.451369] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.451456] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.451627] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port e199eac3-3b7c-4bc7-8608-eaea86437570 not found, creating... [ 703.451889] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.452059] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.452197] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.452403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.455018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.455018] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.455018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.455361] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.455923] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.456138] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.456299] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: e199eac3-3b7c-4bc7-8608-eaea86437570 is going to be created. [ 703.478206] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.478455] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.478577] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.478846] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.479081] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.479304] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.521923] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.521923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.521923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.522078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.522208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.522264] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd is going to be created. [ 703.573551] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.573754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.573805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.574011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.574194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.586726] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd in Status: UNINITIALIZED for 2s [ 703.641826] env[69238]: INFO networking_nsxv3.common.synchronization [None req-6e859418-88d0-44ff-bdc0-cbbaf51ea7e0 tempest-ServersWithSpecificFlavorTestJSON-1275212292 tempest-ServersWithSpecificFlavorTestJSON-1275212292-project-member] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 703.642449] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 703.643147] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.643266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.684802] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.685029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.685080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.685347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.685446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.685802] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.685802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.685928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.686196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.686319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.686420] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f already deleted. [ 703.686523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.770065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.770065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.770065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.770065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.770065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.770065] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 already deleted. [ 703.770065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.770065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.770065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.771524] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.123761] env[69238]: INFO networking_nsxv3.common.synchronization [None req-6f0dbf1e-5582-45cb-96a5-29b00b1a3555 None None] Enqueued Resource ID: 5f91a17b-52c6-4478-a498-a32d272a8390 with Priority: HIGHEST for action port [ 704.124129] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f91a17b-52c6-4478-a498-a32d272a8390 with Priority: HIGHEST for action port [ 704.124942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f91a17b-52c6-4478-a498-a32d272a8390 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.126484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f91a17b-52c6-4478-a498-a32d272a8390" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.126607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f91a17b-52c6-4478-a498-a32d272a8390" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.127135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f91a17b-52c6-4478-a498-a32d272a8390" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.127135] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f91a17b-52c6-4478-a498-a32d272a8390',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.296516] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.296699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.296770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.297220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.298440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.298981] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 already deleted. [ 704.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.629141] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f91a17b-52c6-4478-a498-a32d272a8390 [ 704.630112] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.630112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.631491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.631491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.631491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.631491] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f91a17b-52c6-4478-a498-a32d272a8390 already deleted. [ 704.631491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f91a17b-52c6-4478-a498-a32d272a8390" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.680558] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 in Status: SUCCESS [ 704.680558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.760961] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.763131] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.763131] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.763131] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.763409] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.763634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.763776] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.764050] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.764243] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.764518] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.764595] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.764696] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.764804] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.764911] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.765075] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.765161] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.768732] env[69238]: INFO networking_nsxv3.common.synchronization [None req-422ab354-a8ca-4c71-9408-2d811b235ee6 None None] Enqueued Resource ID: f076b46a-13d5-4214-b092-264e678df375 with Priority: HIGHEST for action port [ 704.769420] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f076b46a-13d5-4214-b092-264e678df375 with Priority: HIGHEST for action port [ 704.769722] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f076b46a-13d5-4214-b092-264e678df375 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.769840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f076b46a-13d5-4214-b092-264e678df375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.769905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f076b46a-13d5-4214-b092-264e678df375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.770171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f076b46a-13d5-4214-b092-264e678df375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.770250] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f076b46a-13d5-4214-b092-264e678df375',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.788142] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.788240] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.788443] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.788727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.789206] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-c595880b-98fe-4b40-a991-3a2a8974f08e taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.789595] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.789814] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.792462] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.793976] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c595880b-98fe-4b40-a991-3a2a8974f08e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.228389] env[69238]: INFO networking_nsxv3.common.synchronization [req-44678c31-1861-4f7e-bd5d-e1bbcaf25d4e req-c5131dfc-1758-4a99-abf9-be149cb10b3a tempest-ServerDiagnosticsTest-275767881 tempest-ServerDiagnosticsTest-275767881-project-member] Enqueued Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_members [ 705.228679] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_members [ 705.228862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.228984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.230993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.231281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.231763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.231945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.232038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.232404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.232535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.233992] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.239552] env[69238]: INFO networking_nsxv3.common.synchronization [req-587fe5ce-2aaa-49dc-8962-2515c5707443 req-fdd209e1-a50e-4d44-b782-9bdf99ba5475 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 705.239552] env[69238]: INFO networking_nsxv3.common.synchronization [req-587fe5ce-2aaa-49dc-8962-2515c5707443 req-fdd209e1-a50e-4d44-b782-9bdf99ba5475 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 705.239552] env[69238]: INFO networking_nsxv3.common.synchronization [req-587fe5ce-2aaa-49dc-8962-2515c5707443 req-fdd209e1-a50e-4d44-b782-9bdf99ba5475 service nova] Enqueued Resource ID: e199eac3-3b7c-4bc7-8608-eaea86437570 with Priority: HIGHEST for action port [ 705.239552] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 705.239552] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 705.241179] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e199eac3-3b7c-4bc7-8608-eaea86437570 with Priority: HIGHEST for action port [ 705.243275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.243275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.243275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.245124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.245124] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.248114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.248114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.248114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.248114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.248114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.248114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.248114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.248114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.248114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.248114] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.251611] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-e199eac3-3b7c-4bc7-8608-eaea86437570 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.252599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.252599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.254097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.254097] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e199eac3-3b7c-4bc7-8608-eaea86437570',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.272546] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f076b46a-13d5-4214-b092-264e678df375 [ 705.273090] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.273090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.273090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.273255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.273286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.273378] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f076b46a-13d5-4214-b092-264e678df375 already deleted. [ 705.273458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f076b46a-13d5-4214-b092-264e678df375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.295895] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.296303] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.296303] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.296563] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.296712] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.296912] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port c595880b-98fe-4b40-a991-3a2a8974f08e not found, creating... [ 705.297166] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.297324] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.297438] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.297651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.297789] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.298176] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.298283] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.298342] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.298594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.298674] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.300355] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: c595880b-98fe-4b40-a991-3a2a8974f08e is going to be created. [ 705.327506] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.327506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.327506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.327506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.327769] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.327885] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.421614] env[69238]: INFO networking_nsxv3.common.synchronization [None req-03658937-87ba-4616-8412-0f46ffafaad7 None None] Enqueued Resource ID: bb8bc1c8-a8c4-41ee-99fa-fb780849888f with Priority: HIGHEST for action port [ 705.421614] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8bc1c8-a8c4-41ee-99fa-fb780849888f with Priority: HIGHEST for action port [ 705.421614] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb8bc1c8-a8c4-41ee-99fa-fb780849888f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.421614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb8bc1c8-a8c4-41ee-99fa-fb780849888f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.421614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb8bc1c8-a8c4-41ee-99fa-fb780849888f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.421820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb8bc1c8-a8c4-41ee-99fa-fb780849888f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.422197] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb8bc1c8-a8c4-41ee-99fa-fb780849888f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.598341] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd in Status: SUCCESS [ 705.598552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.598857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.598947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.599123] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.599419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.599419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.599513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.599513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.599588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.599673] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.741040] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.741040] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.741392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.741392] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea already deleted. [ 705.741392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.746815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.746934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.755838] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.756827] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e199eac3-3b7c-4bc7-8608-eaea86437570 with status ACTIVE [ 705.757023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.757146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.757212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.757417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.757494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.757668] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.757762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.757840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.757965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.758051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.758271] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.758422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.758422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.758902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.758974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.763231] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e199eac3-3b7c-4bc7-8608-eaea86437570 is going to be updated. [ 705.766340] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.766515] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.766649] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.766907] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.767197] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.767359] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.767472] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.767686] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.767833] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.768043] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.768166] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.768281] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.768545] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.768545] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.768648] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.768743] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.789667] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.789915] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.790091] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.790888] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.790888] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-193e39a6-a691-467a-a3cc-0495117d8f6c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.791103] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.791263] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.791669] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.791752] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('193e39a6-a691-467a-a3cc-0495117d8f6c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.793627] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.793754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.793830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.793986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.794890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.794890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e199eac3-3b7c-4bc7-8608-eaea86437570" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.927641] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb8bc1c8-a8c4-41ee-99fa-fb780849888f [ 705.927898] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.928322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.930098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.930098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.930923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.931068] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb8bc1c8-a8c4-41ee-99fa-fb780849888f already deleted. [ 705.931231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb8bc1c8-a8c4-41ee-99fa-fb780849888f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.106100] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.106394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.106394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.106531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.106691] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.106785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.107761] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.107761] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.107761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.108126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.108126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.108126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.108126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.108252] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.157640] env[69238]: INFO networking_nsxv3.common.synchronization [req-ceee7019-76ce-44e9-b1fc-2c4b5b661322 req-54b85185-c1cf-4461-bdb7-f387f18abe56 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 706.157640] env[69238]: INFO networking_nsxv3.common.synchronization [req-ceee7019-76ce-44e9-b1fc-2c4b5b661322 req-54b85185-c1cf-4461-bdb7-f387f18abe56 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 706.157779] env[69238]: INFO networking_nsxv3.common.synchronization [req-ceee7019-76ce-44e9-b1fc-2c4b5b661322 req-54b85185-c1cf-4461-bdb7-f387f18abe56 service nova] Enqueued Resource ID: c595880b-98fe-4b40-a991-3a2a8974f08e with Priority: HIGHEST for action port [ 706.158284] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 706.158415] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 706.158510] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c595880b-98fe-4b40-a991-3a2a8974f08e with Priority: HIGHEST for action port [ 706.158811] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.158967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.159108] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.159226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.159386] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c595880b-98fe-4b40-a991-3a2a8974f08e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.159480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.159539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.159751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.159825] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c595880b-98fe-4b40-a991-3a2a8974f08e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.265590] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.296045] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.296319] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.296453] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.296846] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.296895] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.297090] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 193e39a6-a691-467a-a3cc-0495117d8f6c not found, creating... [ 706.298339] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.298339] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.298339] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.298339] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.298339] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.298575] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.298575] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.298674] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.299746] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.299839] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.299981] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 193e39a6-a691-467a-a3cc-0495117d8f6c is going to be created. [ 706.325701] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.326063] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.326212] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.328029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.328029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.328029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.509486] env[69238]: INFO networking_nsxv3.common.synchronization [None req-920a3297-2c4e-4f74-983a-28e24fcb5a5a tempest-ServerActionsV293TestJSON-586000412 tempest-ServerActionsV293TestJSON-586000412-project-member] Enqueued Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_rules [ 706.510386] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_rules [ 706.510571] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.510683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.510830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.512180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.512180] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.614458] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd: rpc.has_security_group_logging(os_id): False [ 706.638542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.639204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.639320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.639583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.639699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.639938] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.640064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.640131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.640533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.640533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.640656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.640722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.640765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.640951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.641197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.641465] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.641675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.641823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.642494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.642638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.642789] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd is going to be created. [ 706.663070] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c595880b-98fe-4b40-a991-3a2a8974f08e with status ACTIVE [ 706.664044] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.664231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.664299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.664565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.664652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.664793] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.664896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.664968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.665124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.665202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.665382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.665475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.665534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.665668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.665745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.665835] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c595880b-98fe-4b40-a991-3a2a8974f08e is going to be updated. [ 706.689997] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.690395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.690756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.691431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.691431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.691602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c595880b-98fe-4b40-a991-3a2a8974f08e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.746187] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.746348] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.746422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.746623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.746810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.766056] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9a9c21bb-2aa4-4254-89f6-dd4da6b6dc27 tempest-ServerActionsV293TestJSON-586000412 tempest-ServerActionsV293TestJSON-586000412-project-member] Enqueued Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_rules [ 706.766651] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_rules [ 706.767278] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.767675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.770537] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.770849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.770849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.771049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.771108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.771184] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be created. [ 706.778563] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd in Status: IN_PROGRESS for 2s [ 706.818491] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.818685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.818685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.819483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.819483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.832885] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: UNINITIALIZED for 2s [ 707.042789] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.042986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.043033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.043237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.043355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.043607] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 already deleted. [ 707.043607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.047035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.047035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.047035] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.569966] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.569966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.569966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.569966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.569966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.569966] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 already deleted. [ 707.569966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.806369] env[69238]: INFO networking_nsxv3.common.synchronization [req-44678c31-1861-4f7e-bd5d-e1bbcaf25d4e req-12b6fd71-bfdd-455a-812a-9904949e76ac service nova] Enqueued Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_rules [ 707.806566] env[69238]: INFO networking_nsxv3.common.synchronization [req-44678c31-1861-4f7e-bd5d-e1bbcaf25d4e req-12b6fd71-bfdd-455a-812a-9904949e76ac service nova] Enqueued Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_members [ 707.806706] env[69238]: INFO networking_nsxv3.common.synchronization [req-44678c31-1861-4f7e-bd5d-e1bbcaf25d4e req-12b6fd71-bfdd-455a-812a-9904949e76ac service nova] Enqueued Resource ID: 193e39a6-a691-467a-a3cc-0495117d8f6c with Priority: HIGHEST for action port [ 707.807652] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_rules [ 707.807810] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_members [ 707.807928] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 193e39a6-a691-467a-a3cc-0495117d8f6c with Priority: HIGHEST for action port [ 707.808246] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.808371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.808437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.809077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.809077] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.810075] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.810207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.810266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.810465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.810639] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.810750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.810823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.810987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.811089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.811317] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.813780] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-193e39a6-a691-467a-a3cc-0495117d8f6c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.813922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.813961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.814156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.814567] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('193e39a6-a691-467a-a3cc-0495117d8f6c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.314366] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.315491] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.315609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.317682] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 193e39a6-a691-467a-a3cc-0495117d8f6c with status ACTIVE [ 708.318109] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.318380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.318550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.319108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.319108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.319897] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.319897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.319897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.319897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.322018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.322018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.322018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.322018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.322018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.322018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.322018] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 193e39a6-a691-467a-a3cc-0495117d8f6c is going to be updated. [ 708.334025] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9876fd61-29a3-4535-9e93-1f05a95ed0fc None None] Enqueued Resource ID: ae7b5abc-9c92-44a6-b7e5-830239cdd9b1 with Priority: HIGHEST for action port [ 708.335692] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae7b5abc-9c92-44a6-b7e5-830239cdd9b1 with Priority: HIGHEST for action port [ 708.336215] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae7b5abc-9c92-44a6-b7e5-830239cdd9b1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.336492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae7b5abc-9c92-44a6-b7e5-830239cdd9b1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.336647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae7b5abc-9c92-44a6-b7e5-830239cdd9b1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.337015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae7b5abc-9c92-44a6-b7e5-830239cdd9b1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.337206] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae7b5abc-9c92-44a6-b7e5-830239cdd9b1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.348629] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.348629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.348629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.348841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.348877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.349142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-193e39a6-a691-467a-a3cc-0495117d8f6c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.793835] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd in Status: SUCCESS [ 708.793835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.820692] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.841507] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae7b5abc-9c92-44a6-b7e5-830239cdd9b1 [ 708.841507] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.841507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.841507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.841507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.841507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.841507] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae7b5abc-9c92-44a6-b7e5-830239cdd9b1 already deleted. [ 708.841851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae7b5abc-9c92-44a6-b7e5-830239cdd9b1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.847163] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 708.847400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.847565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.847778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.847969] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.848098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.848164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.848319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.848406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.848491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.848591] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.851301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.851301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.851301] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.851301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.851301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.851301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.851301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.851301] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.324370] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.324553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.324645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.324890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.324982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.325105] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea is going to be created. [ 709.354699] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.354906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.356747] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.362225] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.362225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.362225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.362225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.362225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.376356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea in Status: UNINITIALIZED for 2s [ 709.861301] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.360881] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.361130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.361304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.361393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.361843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.361843] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 710.417116] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.417116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.417116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.417116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.417116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.432549] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 710.641039] env[69238]: INFO networking_nsxv3.common.synchronization [None req-6d12d2b0-1818-46aa-89b2-7fc1f43b08a7 None None] Enqueued Resource ID: 1f50032f-bb89-4094-98da-b14b5473b685 with Priority: HIGHEST for action port [ 710.641039] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f50032f-bb89-4094-98da-b14b5473b685 with Priority: HIGHEST for action port [ 710.641804] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f50032f-bb89-4094-98da-b14b5473b685 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.641964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f50032f-bb89-4094-98da-b14b5473b685" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.642087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f50032f-bb89-4094-98da-b14b5473b685" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.642324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f50032f-bb89-4094-98da-b14b5473b685" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.642427] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f50032f-bb89-4094-98da-b14b5473b685',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.145563] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f50032f-bb89-4094-98da-b14b5473b685 [ 711.145878] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.146011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.146364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.146364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.146486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.146520] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f50032f-bb89-4094-98da-b14b5473b685 already deleted. [ 711.147583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f50032f-bb89-4094-98da-b14b5473b685" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.394481] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea in Status: SUCCESS [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.394481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.394481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.394481] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.777260] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b42b555d-6495-496c-b0f9-f40d214f4da3 None None] Enqueued Resource ID: cd4ace23-5ea8-4316-a4f1-707ce541b311 with Priority: HIGHEST for action port [ 711.778107] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4ace23-5ea8-4316-a4f1-707ce541b311 with Priority: HIGHEST for action port [ 711.778256] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd4ace23-5ea8-4316-a4f1-707ce541b311 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.778506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd4ace23-5ea8-4316-a4f1-707ce541b311" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.778506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd4ace23-5ea8-4316-a4f1-707ce541b311" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.778697] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd4ace23-5ea8-4316-a4f1-707ce541b311" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.778773] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd4ace23-5ea8-4316-a4f1-707ce541b311',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.896939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.897276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.897276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.897498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.897678] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.897780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.897852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.898027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.898131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.898225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.898536] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.898536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.898536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.898921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.899107] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.899865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.899930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.900167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.900267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.900388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.900554] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.038987] env[69238]: INFO networking_nsxv3.common.synchronization [req-da114e17-77e7-4a55-b875-0852da381d2e req-8651cb8e-6076-40f0-80ba-22c3f6977820 tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 712.040410] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 712.040942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.041796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.041796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.041796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.043229] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.043715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.043864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.044252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.044335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.044649] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.281114] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd4ace23-5ea8-4316-a4f1-707ce541b311 [ 712.281466] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.281888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.281888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.282029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.282029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.282216] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd4ace23-5ea8-4316-a4f1-707ce541b311 already deleted. [ 712.282216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd4ace23-5ea8-4316-a4f1-707ce541b311" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.405341] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdc2f887-03c1-42e5-b9e7-cefa5083fdea: rpc.has_security_group_logging(os_id): False [ 712.426303] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.426523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.426665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.426847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.426977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.427184] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.427339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.427402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.427615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.427675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.427859] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.427989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.428824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.429065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.429156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.429363] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.429445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.429505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.429652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.429749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.429841] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea is going to be created. [ 712.444425] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 712.444753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.445009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.445275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.445569] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.446407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.446407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.446407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.446407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.446407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.446628] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.446628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.446714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.446918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.447539] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.447685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.447751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.447935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.448052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.448174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.448268] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.496380] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.496380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.496380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.496380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.496380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.511705] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea in Status: IN_PROGRESS for 2s [ 712.550265] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.550585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.551018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.551357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.551557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.551882] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.552126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.552287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.552539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.552718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.553291] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c already deleted. [ 712.553790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.950836] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0a6d09e-93ad-4f0a-b077-df666e70f18f: rpc.has_security_group_logging(os_id): False [ 712.970446] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.970682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.970682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.970916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.971018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.971236] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.971340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.971406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.971595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.971686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.971876] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.971970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.972035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.972179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.972254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.972429] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.972519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.972581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.972716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.972791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.972876] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be created. [ 713.041160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.041324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.041395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.041598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.041798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.055213] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 713.246345] env[69238]: INFO networking_nsxv3.common.synchronization [req-1d2c9c26-f4cd-4875-a711-1beaac4179fa req-85cdc9d6-408e-47f3-9466-6bf35541f1e5 tempest-DeleteServersAdminTestJSON-8335460 tempest-DeleteServersAdminTestJSON-8335460-project-admin] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 713.247025] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 713.247491] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.247700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.247832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.248150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.253408] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.253408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.253408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.253408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.253408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.253408] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.314806] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.315315] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.315315] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.315724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.316126] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.316368] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.316539] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.316815] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.317074] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.317349] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.317567] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.317764] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.317949] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.318126] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.318388] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.318842] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.344019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.345032] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.345032] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.345032] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.345032] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-40e559ea-2ed4-45db-a141-1b1bb3bcad11 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.345264] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.345264] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.345568] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.345713] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40e559ea-2ed4-45db-a141-1b1bb3bcad11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.759198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.759761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.759865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.760138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.760192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.760391] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.760496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.760556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.760802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.760802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.760891] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be updated. [ 713.790364] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.790481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.790564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.790778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.790912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.799700] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: IN_PROGRESS for 2s [ 713.848645] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.849052] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.849052] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.849303] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.849451] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.849603] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 40e559ea-2ed4-45db-a141-1b1bb3bcad11 not found, creating... [ 713.850224] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.850224] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.850358] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.850491] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.850628] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.850903] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.854017] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.854017] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.854017] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.854017] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.854017] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 40e559ea-2ed4-45db-a141-1b1bb3bcad11 is going to be created. [ 713.879308] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.880753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.880753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.880753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.880753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.880945] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.076374] env[69238]: INFO networking_nsxv3.common.synchronization [None req-56affce3-6585-4edc-b848-936b6ce74efb None None] Enqueued Resource ID: 6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c with Priority: HIGHEST for action port [ 714.076374] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c with Priority: HIGHEST for action port [ 714.076935] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.077081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.077149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.077410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.077495] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.177737] env[69238]: INFO networking_nsxv3.common.synchronization [req-e81f176f-40f9-48c1-a5f9-2d1157eb4942 req-89be8d24-de50-45f4-885b-eacc259f0adf tempest-ServerDiagnosticsNegativeTest-479324342 tempest-ServerDiagnosticsNegativeTest-479324342-project-member] Enqueued Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_members [ 714.178164] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_members [ 714.178483] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e00b7de-bd62-4244-a65e-9ce263afed97 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.178714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.178714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.178952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.179758] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.180500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.180500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.180500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.180500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.180500] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.531710] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea in Status: SUCCESS [ 714.534090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.579276] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c [ 714.579653] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.579802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.581228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.581228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.581228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.581228] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c already deleted. [ 714.581228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b0406f0-ec25-463a-a10d-f6d7cf6c7d3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.685172] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.685253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.685366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.685660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.685794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.686098] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.686238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.686823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.686823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.686823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.686823] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 already deleted. [ 714.686823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.070969] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 715.071537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.071537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.075346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.075346] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.130944] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.131410] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.131621] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.131889] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.132445] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.133292] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.133454] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.133822] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.134034] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.134299] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.134431] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.134626] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.134849] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.134982] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.136996] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.137254] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.161323] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.163634] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.163634] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.163634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.163634] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4a03f3fb-4405-49f5-9a13-3b74301a3223 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.163634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.163634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.163634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.163634] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a03f3fb-4405-49f5-9a13-3b74301a3223',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.312032] env[69238]: INFO networking_nsxv3.common.synchronization [req-da114e17-77e7-4a55-b875-0852da381d2e req-d0aff899-ecd7-40af-b21c-20b83b46a41f service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 715.312442] env[69238]: INFO networking_nsxv3.common.synchronization [req-da114e17-77e7-4a55-b875-0852da381d2e req-d0aff899-ecd7-40af-b21c-20b83b46a41f service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 715.312729] env[69238]: INFO networking_nsxv3.common.synchronization [req-da114e17-77e7-4a55-b875-0852da381d2e req-d0aff899-ecd7-40af-b21c-20b83b46a41f service nova] Enqueued Resource ID: 40e559ea-2ed4-45db-a141-1b1bb3bcad11 with Priority: HIGHEST for action port [ 715.313531] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 715.314934] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 715.315222] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40e559ea-2ed4-45db-a141-1b1bb3bcad11 with Priority: HIGHEST for action port [ 715.315651] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.315914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.316111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.316417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.316607] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.319211] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.319712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.319883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.320197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.320765] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.321052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.328461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.328461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.328461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.328461] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.328461] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-40e559ea-2ed4-45db-a141-1b1bb3bcad11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.328461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.328461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.328461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.328461] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40e559ea-2ed4-45db-a141-1b1bb3bcad11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.341156] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9814e78b-c3de-4289-a900-392e8dfe600f tempest-ServersTestFqdnHostnames-543136473 tempest-ServersTestFqdnHostnames-543136473-project-member] Enqueued Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_rules [ 715.342691] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_rules [ 715.343129] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3efc2ce-5009-447c-a310-4d3178a7395c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.343312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.343408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.343792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.343885] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.434986] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e81965ad-d578-4328-bf0d-b1855079a9d3 tempest-ServersTestFqdnHostnames-543136473 tempest-ServersTestFqdnHostnames-543136473-project-member] Enqueued Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_rules [ 715.435435] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_rules [ 715.435740] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3efc2ce-5009-447c-a310-4d3178a7395c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.435851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.577361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.577677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.577677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.577974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.578514] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.578730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.581339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.582057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.582057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.582188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.582810] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.669865] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.669865] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.669865] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.670206] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.670370] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.670526] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4a03f3fb-4405-49f5-9a13-3b74301a3223 not found, creating... [ 715.670781] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.671386] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.671386] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.671386] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.671482] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.672021] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.672119] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.672185] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.672401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.672536] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.672678] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4a03f3fb-4405-49f5-9a13-3b74301a3223 is going to be created. [ 715.693737] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.694009] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.694170] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.694542] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.694794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.695560] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.812047] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: SUCCESS [ 715.812244] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 deletion is rescheduled due to dependency. [ 715.812427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.830059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.830157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.830362] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.832765] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40e559ea-2ed4-45db-a141-1b1bb3bcad11 with status ACTIVE [ 715.832980] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.833146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.833409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.833409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.833500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.833766] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.835369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.835369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.835369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.835369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.835369] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.835369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.835732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.835873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.836076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.836176] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40e559ea-2ed4-45db-a141-1b1bb3bcad11 is going to be updated. [ 715.865455] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.865644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.865685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.866032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.866238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.866437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40e559ea-2ed4-45db-a141-1b1bb3bcad11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.874383] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.874383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.874383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.874590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.874590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.874647] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3efc2ce-5009-447c-a310-4d3178a7395c already deleted. [ 715.875030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.875030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.876790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.876790] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.085222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.085645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.085725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.086035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.087319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.087319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.087319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.087319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.087319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.087319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.087319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.087718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.087718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.087718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.091066] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.091066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.091066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.091066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.091066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.091066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.091066] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.332526] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.401987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.402299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.402407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.402612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.402764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.402807] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3efc2ce-5009-447c-a310-4d3178a7395c already deleted. [ 716.402917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.593067] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0a6d09e-93ad-4f0a-b077-df666e70f18f: rpc.has_security_group_logging(os_id): False [ 716.613552] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.613723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.613863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.614218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.614327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.614668] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.615228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.615228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.615228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.615378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.617100] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.619025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.619025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.619025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.619025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.619334] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.619459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.619559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.619820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.619940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.620049] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 716.729437] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.729689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.729769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.729979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.730178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.744653] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 716.837160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.838438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.838560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.838806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.838909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.839113] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be created. [ 716.870154] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.870154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.871162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.871594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.872474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.887764] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: UNINITIALIZED for 2s [ 717.340128] env[69238]: INFO networking_nsxv3.common.synchronization [req-e81f176f-40f9-48c1-a5f9-2d1157eb4942 req-16f71c0c-b7a0-4b04-b5f1-42db5d2ed7fc service nova] Enqueued Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_rules [ 717.340899] env[69238]: INFO networking_nsxv3.common.synchronization [req-e81f176f-40f9-48c1-a5f9-2d1157eb4942 req-16f71c0c-b7a0-4b04-b5f1-42db5d2ed7fc service nova] Enqueued Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_members [ 717.341019] env[69238]: INFO networking_nsxv3.common.synchronization [req-e81f176f-40f9-48c1-a5f9-2d1157eb4942 req-16f71c0c-b7a0-4b04-b5f1-42db5d2ed7fc service nova] Enqueued Resource ID: 4a03f3fb-4405-49f5-9a13-3b74301a3223 with Priority: HIGHEST for action port [ 717.341704] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_rules [ 717.341895] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_members [ 717.342047] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a03f3fb-4405-49f5-9a13-3b74301a3223 with Priority: HIGHEST for action port [ 717.342422] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e00b7de-bd62-4244-a65e-9ce263afed97 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.342607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.342705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.343064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.343189] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.345614] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e00b7de-bd62-4244-a65e-9ce263afed97 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.346610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.346784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.347127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.347623] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.348605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.348772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.349091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.349284] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.352949] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.352949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a03f3fb-4405-49f5-9a13-3b74301a3223 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.352949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.352949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.352949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.352949] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a03f3fb-4405-49f5-9a13-3b74301a3223',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.587686] env[69238]: INFO networking_nsxv3.common.synchronization [req-1337b2a1-bfc3-43ce-bbf7-0c71136e49c2 req-5cbfe485-1b28-46fb-8a6d-962b34b1cdda tempest-ListImageFiltersTestJSON-266287970 tempest-ListImageFiltersTestJSON-266287970-project-member] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 717.587686] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 717.587686] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.587686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.587686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.587686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.587686] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.587686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.587686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.588279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.588279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.588279] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.841638] env[69238]: INFO networking_nsxv3.common.synchronization [None req-a133b928-a97b-41ed-9879-ba7404de07e3 None None] Enqueued Resource ID: af324b05-ffa8-447d-82da-94019578a407 with Priority: HIGHEST for action port [ 717.842794] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af324b05-ffa8-447d-82da-94019578a407 with Priority: HIGHEST for action port [ 717.843404] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-af324b05-ffa8-447d-82da-94019578a407 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.843404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af324b05-ffa8-447d-82da-94019578a407" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.843598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af324b05-ffa8-447d-82da-94019578a407" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.843854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af324b05-ffa8-447d-82da-94019578a407" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.843954] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af324b05-ffa8-447d-82da-94019578a407',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.859315] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.859315] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e00b7de-bd62-4244-a65e-9ce263afed97 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.859315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.859315] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a03f3fb-4405-49f5-9a13-3b74301a3223 with status ACTIVE [ 717.859888] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.859888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.859888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.859888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.860142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.860142] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.860264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.860264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.861646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.861646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.861646] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.861646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.861646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.861646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.861646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.861646] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a03f3fb-4405-49f5-9a13-3b74301a3223 is going to be updated. [ 717.889047] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.889047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.889287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.889335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.889478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.890604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a03f3fb-4405-49f5-9a13-3b74301a3223" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.035137] env[69238]: INFO networking_nsxv3.common.synchronization [req-437ede40-238d-46f0-af04-602b9f4bd838 req-acd12d83-481d-4543-b437-2f9bf189d778 tempest-AttachInterfacesV270Test-1276176338 tempest-AttachInterfacesV270Test-1276176338-project-member] Enqueued Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_members [ 718.036067] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGHEST for action security_group_members [ 718.037211] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.037679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.037679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.037679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.037853] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.037919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.037919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.038356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.038356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.038356] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.093513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.093513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.093643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.093807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.093977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.094158] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.094285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.094417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.094500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.094538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.094637] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed already deleted. [ 718.094881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.346820] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af324b05-ffa8-447d-82da-94019578a407 [ 718.346820] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.346820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.346820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.347182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.347182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.347182] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af324b05-ffa8-447d-82da-94019578a407 already deleted. [ 718.347275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af324b05-ffa8-447d-82da-94019578a407" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.360524] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.541452] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.541614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.541707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.541977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.542064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.542267] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.542372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.542427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.542593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.542671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.542760] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 is going to be updated. [ 718.577331] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.577574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.577574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.577695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.577811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.590092] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 in Status: IN_PROGRESS for 2s [ 718.759464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 718.759784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.864877] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.864877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.865383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.865426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.866024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.866024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 is going to be created. [ 718.900242] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.900242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.900242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.900242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.900242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.902211] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 718.902889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.904054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.904439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.905050] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.905050] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.905050] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.905544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.905979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.906254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.906472] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.914270] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 in Status: UNINITIALIZED for 2s [ 719.261151] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.261151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.261151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.261151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.261151] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.267040] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.267040] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.267040] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.267040] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.267040] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.267040] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.267040] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.267040] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.267040] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.267040] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.267040] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.290534] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.290534] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.290534] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.290788] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.291417] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-808792cb-5be2-45fa-bdeb-60c62dd8f671 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.291606] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.291812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.292226] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.292311] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('808792cb-5be2-45fa-bdeb-60c62dd8f671',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.409466] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.703207] env[69238]: INFO networking_nsxv3.common.synchronization [req-996ea6bf-837c-4928-8e4c-a1e82d6b789e req-d2f5503e-46d1-4ced-ad04-3ea1c4c46fe3 tempest-FloatingIPsAssociationTestJSON-1554317950 tempest-FloatingIPsAssociationTestJSON-1554317950-project-member] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 719.703648] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 719.704158] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.704507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.704665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.705021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.706347] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.706573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.706800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.707067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.707281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.707487] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.796781] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.796781] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.796781] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.796781] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.796781] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.796781] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 808792cb-5be2-45fa-bdeb-60c62dd8f671 not found, creating... [ 719.796781] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.797396] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.797396] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.797502] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.797574] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.797873] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.798049] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.798170] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.798388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.798535] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.798654] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 808792cb-5be2-45fa-bdeb-60c62dd8f671 is going to be created. [ 719.824245] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.824245] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.824245] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.824245] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.824679] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.824843] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.913432] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161eb351-451d-49f3-803f-374b4ae2741c: rpc.has_security_group_logging(os_id): False [ 719.941195] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.941195] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.941195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.941195] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be created. [ 720.029139] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.029139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.029139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.029139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.029139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.044652] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 720.210234] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.210538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.210538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.210816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.210915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.211063] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.211183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.211249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.211384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.211871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.212044] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc already deleted. [ 720.212158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.262651] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9566a6a3-5e36-46d4-9a5d-0b03a84a1916 None None] Enqueued Resource ID: dbcfa1da-9fd4-4d38-ad24-5adca1fd5846 with Priority: HIGHEST for action port [ 720.264029] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcfa1da-9fd4-4d38-ad24-5adca1fd5846 with Priority: HIGHEST for action port [ 720.264029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbcfa1da-9fd4-4d38-ad24-5adca1fd5846 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.266467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbcfa1da-9fd4-4d38-ad24-5adca1fd5846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.266467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbcfa1da-9fd4-4d38-ad24-5adca1fd5846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.266467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbcfa1da-9fd4-4d38-ad24-5adca1fd5846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.266467] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbcfa1da-9fd4-4d38-ad24-5adca1fd5846',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.602686] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 in Status: SUCCESS [ 720.602898] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 deletion is rescheduled due to dependency. [ 720.603728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.759739] env[69238]: INFO networking_nsxv3.common.synchronization [req-e2aeb0e3-8e12-4789-b3e5-8eba7eb102b5 req-d0c4785a-c21d-45f9-bf25-6fe671a32b94 tempest-ServerExternalEventsTest-1268933474 tempest-ServerExternalEventsTest-1268933474-project-member] Enqueued Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_members [ 720.760972] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd with Priority: HIGHEST for action security_group_members [ 720.761971] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.762183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.762292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.762559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.763081] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.766651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.766651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.766651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.766651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.766651] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.768768] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbcfa1da-9fd4-4d38-ad24-5adca1fd5846 [ 720.768982] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.769173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.769173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.769390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.769485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.769578] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbcfa1da-9fd4-4d38-ad24-5adca1fd5846 already deleted. [ 720.769667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbcfa1da-9fd4-4d38-ad24-5adca1fd5846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.773113] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-862 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.773388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.773580] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.773943] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.774275] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.774501] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.774635] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.775092] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.775092] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.775274] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.775395] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.775516] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.775632] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.775744] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.775851] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.775986] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.796901] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.797444] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.797644] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.797898] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.798350] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.798630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.798827] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.799217] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.799380] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eefc813-f2d7-4930-b03c-2cc70a3e7f03',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.924139] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 in Status: SUCCESS [ 720.924520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.924627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.924891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.925145] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.925277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.925352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.925535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.925637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.925735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.925826] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.126631] env[69238]: INFO networking_nsxv3.common.synchronization [req-1337b2a1-bfc3-43ce-bbf7-0c71136e49c2 req-ff97d0a7-56eb-4cb0-927c-6edf74a832e9 service nova] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_rules [ 721.126810] env[69238]: INFO networking_nsxv3.common.synchronization [req-1337b2a1-bfc3-43ce-bbf7-0c71136e49c2 req-ff97d0a7-56eb-4cb0-927c-6edf74a832e9 service nova] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 721.126949] env[69238]: INFO networking_nsxv3.common.synchronization [req-1337b2a1-bfc3-43ce-bbf7-0c71136e49c2 req-ff97d0a7-56eb-4cb0-927c-6edf74a832e9 service nova] Enqueued Resource ID: 808792cb-5be2-45fa-bdeb-60c62dd8f671 with Priority: HIGHEST for action port [ 721.127692] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_rules [ 721.127692] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 721.127812] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808792cb-5be2-45fa-bdeb-60c62dd8f671 with Priority: HIGHEST for action port [ 721.127968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.128357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.128423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.128723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.128993] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.129730] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.130110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.130110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.130110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.130244] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.130293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.130352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.130485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.130574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.130661] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.131682] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-808792cb-5be2-45fa-bdeb-60c62dd8f671 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.132054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.132054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.132161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.132161] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('808792cb-5be2-45fa-bdeb-60c62dd8f671',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.266879] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.267494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.267494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.267494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.267494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.267664] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.267731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.268028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.268028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.268028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.268152] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd is going to be updated. [ 721.296082] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.296233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.296329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.296517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.296655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.302789] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.302997] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.303152] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.303399] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.303541] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.303688] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 3eefc813-f2d7-4930-b03c-2cc70a3e7f03 not found, creating... [ 721.303977] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.304163] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.304275] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.304490] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.306042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.306042] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.306042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.306042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.306042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.306042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.306042] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 3eefc813-f2d7-4930-b03c-2cc70a3e7f03 is going to be created. [ 721.311020] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd in Status: IN_PROGRESS for 2s [ 721.331848] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.332363] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.332728] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.333498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.333871] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.335410] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.379200] env[69238]: INFO networking_nsxv3.common.synchronization [None req-87403db1-08af-4b73-be0b-82c9da1970c5 tempest-ServersTestBootFromVolume-656707009 tempest-ServersTestBootFromVolume-656707009-project-member] Enqueued Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_rules [ 721.379200] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_rules [ 721.379200] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69fbfff4-4d12-49da-9085-7d562819c005 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.379200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.379200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.379200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.379200] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.433503] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e00b7de-bd62-4244-a65e-9ce263afed97 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.433710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.433790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.434091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.434251] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.434732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.434732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.434732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.434864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.434989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.435226] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e00b7de-bd62-4244-a65e-9ce263afed97 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.435302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.435366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.435557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.436037] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.436037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.436037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.436037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.436234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.436234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.436330] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.486024] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c4e940c4-2955-4721-a412-62024d04a311 tempest-ServersTestBootFromVolume-656707009 tempest-ServersTestBootFromVolume-656707009-project-member] Enqueued Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_rules [ 721.489018] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_rules [ 721.489018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69fbfff4-4d12-49da-9085-7d562819c005 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.489018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.634609] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.634781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.635039] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.635943] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 808792cb-5be2-45fa-bdeb-60c62dd8f671 with status ACTIVE [ 721.636990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.636990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.636990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.636990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.636990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.636990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.638029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.638106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.638394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.638526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.638772] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.638884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.638951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.639151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.639258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.639368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 808792cb-5be2-45fa-bdeb-60c62dd8f671 is going to be updated. [ 721.683234] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.683382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.683382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.683595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.683766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.683954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-808792cb-5be2-45fa-bdeb-60c62dd8f671" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.906894] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.907115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.907201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.908181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.908181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.908181] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69fbfff4-4d12-49da-9085-7d562819c005 already deleted. [ 721.908181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.908181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.908181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.908493] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.938549] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e00b7de-bd62-4244-a65e-9ce263afed97: rpc.has_security_group_logging(os_id): False [ 721.961159] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.961353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.961353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.961947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.961947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.961947] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.962214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.962214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.962214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.962298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.963308] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.963308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.963308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.963308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.963308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.963308] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.963658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.963734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.963949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.964020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.964108] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 is going to be created. [ 722.057880] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 722.058222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.059146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.059271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.059339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.059552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.059758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.072894] env[69238]: INFO networking_nsxv3.common.synchronization [req-c304bf06-3a19-4004-b806-44046dd36671 req-380c2454-cbcd-45e2-93ac-9d0d1e8b823f tempest-ListImageFiltersTestJSON-266287970 tempest-ListImageFiltersTestJSON-266287970-project-member] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 722.074085] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 in Status: IN_PROGRESS for 2s [ 722.074660] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 722.075221] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.075327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.141934] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.435798] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.436093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.436282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.436593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.436792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.436962] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69fbfff4-4d12-49da-9085-7d562819c005 already deleted. [ 722.437615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.646755] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.647254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.650258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.650258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.650258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.650258] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed is going to be created. [ 722.679931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.679931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.680114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.680243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.680441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.690396] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: UNINITIALIZED for 2s [ 723.286438] env[69238]: INFO networking_nsxv3.common.synchronization [req-996ea6bf-837c-4928-8e4c-a1e82d6b789e req-5081050c-e086-4202-8842-6039f6c3dd7f service nova] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_rules [ 723.286722] env[69238]: INFO networking_nsxv3.common.synchronization [req-996ea6bf-837c-4928-8e4c-a1e82d6b789e req-5081050c-e086-4202-8842-6039f6c3dd7f service nova] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 723.286872] env[69238]: INFO networking_nsxv3.common.synchronization [req-996ea6bf-837c-4928-8e4c-a1e82d6b789e req-5081050c-e086-4202-8842-6039f6c3dd7f service nova] Enqueued Resource ID: 3eefc813-f2d7-4930-b03c-2cc70a3e7f03 with Priority: HIGHEST for action port [ 723.287472] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_rules [ 723.287669] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 723.287787] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eefc813-f2d7-4930-b03c-2cc70a3e7f03 with Priority: HIGHEST for action port [ 723.288118] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.288275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.288348] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.288592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.288675] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.290531] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.290763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.291314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.291314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.291481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.291625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.292152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.292534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.292692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.292792] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.294519] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.298019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.298019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.298019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.298019] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eefc813-f2d7-4930-b03c-2cc70a3e7f03',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.325019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd in Status: SUCCESS [ 723.325019] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd deletion is rescheduled due to dependency. [ 723.325019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.502048] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.502048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.502048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.502048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.502048] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.502048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.502048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.502798] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.503072] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.503376] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.503594] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.503812] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.504117] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.504341] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.504543] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.504791] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.530202] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.530202] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.530202] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.530202] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.530202] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.530202] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.530202] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.530202] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.530202] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.799569] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.799740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.801070] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.801871] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eefc813-f2d7-4930-b03c-2cc70a3e7f03 with status ACTIVE [ 723.802162] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.802562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.802562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.803659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.803659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.803659] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.803659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.803659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.803659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.803659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.804098] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.804098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.804098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.804876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.804876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.805071] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eefc813-f2d7-4930-b03c-2cc70a3e7f03 is going to be updated. [ 723.837791] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.837791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.837791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.837791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.837791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.837791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eefc813-f2d7-4930-b03c-2cc70a3e7f03" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.033837] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.034179] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.034417] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.034594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.034764] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.034929] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 not found, creating... [ 724.035248] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.035404] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.036409] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.036849] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.036849] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.037122] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.037273] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.037437] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.037692] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.037851] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.037996] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 is going to be created. [ 724.061431] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.061674] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.061809] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.062116] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.062358] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.062833] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.089480] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 in Status: SUCCESS [ 724.089541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.309191] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.389518] env[69238]: INFO networking_nsxv3.common.synchronization [None req-6b26c7ba-3dd3-47b8-b257-889d3731dda9 None None] Enqueued Resource ID: 71dab6d3-39a4-412c-bd81-2dac528461e5 with Priority: HIGHEST for action port [ 724.390120] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71dab6d3-39a4-412c-bd81-2dac528461e5 with Priority: HIGHEST for action port [ 724.391142] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-71dab6d3-39a4-412c-bd81-2dac528461e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.391642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71dab6d3-39a4-412c-bd81-2dac528461e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.391642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71dab6d3-39a4-412c-bd81-2dac528461e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.391838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71dab6d3-39a4-412c-bd81-2dac528461e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.392080] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71dab6d3-39a4-412c-bd81-2dac528461e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.703541] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: SUCCESS [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.703541] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.703541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.703541] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.704715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.704795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.705042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.705195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.705276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.705445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.705545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.705652] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.813048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.813048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.813048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.813048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.813048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.813599] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc is going to be created. [ 724.839593] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.839593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.839593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.841102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.841728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.853849] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: UNINITIALIZED for 2s [ 724.896736] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71dab6d3-39a4-412c-bd81-2dac528461e5 [ 724.897110] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.897372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.897372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.897668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.897788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.897928] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71dab6d3-39a4-412c-bd81-2dac528461e5 already deleted. [ 724.898273] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71dab6d3-39a4-412c-bd81-2dac528461e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.207841] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.208124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.208513] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.711695] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.958109] env[69238]: INFO networking_nsxv3.common.synchronization [req-c304bf06-3a19-4004-b806-44046dd36671 req-3d01de09-f686-4492-8cd2-9102739dab9a service nova] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_rules [ 725.958398] env[69238]: INFO networking_nsxv3.common.synchronization [req-c304bf06-3a19-4004-b806-44046dd36671 req-3d01de09-f686-4492-8cd2-9102739dab9a service nova] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 725.958623] env[69238]: INFO networking_nsxv3.common.synchronization [req-c304bf06-3a19-4004-b806-44046dd36671 req-3d01de09-f686-4492-8cd2-9102739dab9a service nova] Enqueued Resource ID: f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 with Priority: HIGHEST for action port [ 725.960706] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_rules [ 725.960974] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 725.961190] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 with Priority: HIGHEST for action port [ 725.961667] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.961878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.962490] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.962490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.964706] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.964706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.964706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.964706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.964706] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.220324] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.220324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.220324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.220324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.220324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.220324] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed is going to be updated. [ 726.263668] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.263845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.263899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.265635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.265899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.279223] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: IN_PROGRESS for 2s [ 726.467749] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 with status ACTIVE [ 726.470346] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.470346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.470346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.471640] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.471640] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.471640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.472245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.472245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.472245] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44 is going to be updated. [ 726.498565] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.498716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.498837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.499041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.499252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.499369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3e0d2c8-909f-4bc3-8f2c-bd485e1e6f44" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.869738] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: SUCCESS [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.869738] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.869738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.869738] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.372893] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.373066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.373138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.374091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.374091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.374091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.374091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.374091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.374091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.374091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.374424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.374424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.374424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.374519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.374647] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.374737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.374795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.374929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.375069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.375156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.375237] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.433622] env[69238]: INFO networking_nsxv3.common.synchronization [None req-4755631e-f059-434d-b87b-5837965f82bc None None] Enqueued Resource ID: 30b840ac-8ac5-4269-aa48-5e4b1142b9b0 with Priority: HIGHEST for action port [ 727.433622] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b840ac-8ac5-4269-aa48-5e4b1142b9b0 with Priority: HIGHEST for action port [ 727.439570] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-30b840ac-8ac5-4269-aa48-5e4b1142b9b0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.439570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30b840ac-8ac5-4269-aa48-5e4b1142b9b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.439570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30b840ac-8ac5-4269-aa48-5e4b1142b9b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.439570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30b840ac-8ac5-4269-aa48-5e4b1142b9b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.439570] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30b840ac-8ac5-4269-aa48-5e4b1142b9b0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.494151] env[69238]: INFO networking_nsxv3.common.synchronization [req-fa0c5642-2236-45b0-bca2-f34e0dd0e5f9 req-2b439ec2-d65b-4ffd-ad74-9b7e1bbf6b7f tempest-VolumesAssistedSnapshotsTest-1717929212 tempest-VolumesAssistedSnapshotsTest-1717929212-project-member] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_members [ 727.495267] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_members [ 727.495555] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.496858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.496961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.497303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.497514] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.497645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.497740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.497911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.498051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.498847] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.780020] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d7706994-60b8-4442-afc8-49f1c8cb2d53 None None] Enqueued Resource ID: a10698ea-e802-4072-8278-6b9a94fc45d4 with Priority: HIGHEST for action port [ 727.780020] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10698ea-e802-4072-8278-6b9a94fc45d4 with Priority: HIGHEST for action port [ 727.783186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a10698ea-e802-4072-8278-6b9a94fc45d4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.783186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a10698ea-e802-4072-8278-6b9a94fc45d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.783186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a10698ea-e802-4072-8278-6b9a94fc45d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.783186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a10698ea-e802-4072-8278-6b9a94fc45d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.783186] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a10698ea-e802-4072-8278-6b9a94fc45d4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.878027] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bf1f1-444a-46b5-b4a0-baa2f52159cc: rpc.has_security_group_logging(os_id): False [ 727.905635] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.905635] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.905635] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.905635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.906480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.906480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.910340] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.910457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.911159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.911159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.911159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.911159] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc is going to be created. [ 727.942677] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30b840ac-8ac5-4269-aa48-5e4b1142b9b0 [ 727.942677] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.942997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.942997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.944548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.944548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.944548] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30b840ac-8ac5-4269-aa48-5e4b1142b9b0 already deleted. [ 727.944548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30b840ac-8ac5-4269-aa48-5e4b1142b9b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.982109] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.982488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.982488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.983348] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.983348] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.987129] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.987129] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-877" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.987129] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-877" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.987129] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-877" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.987391] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.987458] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.987622] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.987764] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.987914] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.988139] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.988308] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.988429] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.988538] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.988646] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.988754] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.988895] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.995184] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: IN_PROGRESS for 2s [ 728.002187] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.002187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.004342] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.004342] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf already deleted. [ 728.004342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.032787] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.032787] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.032787] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.032787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-877" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.032787] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-25e1ce3d-f01e-4485-b5b5-73dd8e468523 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.032787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.032787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.032787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.032787] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25e1ce3d-f01e-4485-b5b5-73dd8e468523',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.286052] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a10698ea-e802-4072-8278-6b9a94fc45d4 [ 728.286298] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.286435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.286503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.286710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.286796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.286895] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a10698ea-e802-4072-8278-6b9a94fc45d4 already deleted. [ 728.286972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a10698ea-e802-4072-8278-6b9a94fc45d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.290624] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: SUCCESS [ 728.290909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.291012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.292151] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.292151] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.292151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.292708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.295331] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.295331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.295477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.295509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.295589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.295704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.295761] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.297317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.299085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.299085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.299085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.299085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.299085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.299085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.299085] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.511041] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e2d5c44c-4e8e-4ec8-acc9-098baf625911 None None] Enqueued Resource ID: ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259 with Priority: HIGHEST for action port [ 728.511041] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259 with Priority: HIGHEST for action port [ 728.513890] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.513890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.513890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.513890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.513890] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.545225] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.546630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.546630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.546630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.546630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.546630] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 25e1ce3d-f01e-4485-b5b5-73dd8e468523 not found, creating... [ 728.546630] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.547304] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.547304] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.547304] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.547304] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.547987] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.547987] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.547987] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.548376] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.548496] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.548709] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 25e1ce3d-f01e-4485-b5b5-73dd8e468523 is going to be created. [ 728.579302] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.579646] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.579889] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.580233] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.580548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.581539] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.612968] env[69238]: INFO networking_nsxv3.common.synchronization [None req-4e913dcd-c98a-4039-8397-4033fe6c74c6 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 728.612968] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 728.613599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.614183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.614448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.615292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.615292] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.801381] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aee600fe-2d5e-4376-8f72-81cf57665aed: rpc.has_security_group_logging(os_id): False [ 728.802644] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.824929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.825128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.825178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.825466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.825573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.825793] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.826014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.826014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.826152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.826233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.826497] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.826599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.826659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.827132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.827132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.827508] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.831144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.831144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.831144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.831144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.831144] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed is going to be created. [ 728.865245] env[69238]: INFO networking_nsxv3.common.synchronization [None req-cc471150-8b4c-4871-80f2-279ca8f94bae tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 728.868531] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 728.868531] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.868531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.918262] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.918645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.918645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.918740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.921093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.933074] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: IN_PROGRESS for 2s [ 729.018999] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259 [ 729.018999] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.018999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.018999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.018999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.018999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.018999] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259 already deleted. [ 729.018999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef436ec5-6c1a-4a30-8dd3-83dfa7e0e259" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.138286] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.138458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.138458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.138701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.138834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.138945] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 already deleted. [ 729.139165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.139346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.139529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.139612] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.306619] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.664602] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.664884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.664884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.665742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.665742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.665742] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 already deleted. [ 729.665742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.812114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.812290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.812363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.812590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.812691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.812790] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed is going to be updated. [ 729.848018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.848018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.848018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.848333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.848333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.857893] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: IN_PROGRESS for 2s [ 730.008691] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: SUCCESS [ 730.009288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.135953] env[69238]: INFO networking_nsxv3.common.synchronization [req-fa0c5642-2236-45b0-bca2-f34e0dd0e5f9 req-5db83c34-884b-460f-8e7e-844d3ec273cc service nova] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_rules [ 730.136807] env[69238]: INFO networking_nsxv3.common.synchronization [req-fa0c5642-2236-45b0-bca2-f34e0dd0e5f9 req-5db83c34-884b-460f-8e7e-844d3ec273cc service nova] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_members [ 730.136807] env[69238]: INFO networking_nsxv3.common.synchronization [req-fa0c5642-2236-45b0-bca2-f34e0dd0e5f9 req-5db83c34-884b-460f-8e7e-844d3ec273cc service nova] Enqueued Resource ID: 25e1ce3d-f01e-4485-b5b5-73dd8e468523 with Priority: HIGHEST for action port [ 730.136807] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_rules [ 730.136807] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_members [ 730.136807] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25e1ce3d-f01e-4485-b5b5-73dd8e468523 with Priority: HIGHEST for action port [ 730.138063] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.138063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.138063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.138796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.138796] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.139189] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.139306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.139376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.139826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.140106] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.140218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.140279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.141020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.141020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.141020] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.142382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-25e1ce3d-f01e-4485-b5b5-73dd8e468523 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.142552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.142552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.142704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.142775] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25e1ce3d-f01e-4485-b5b5-73dd8e468523',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.293124] env[69238]: INFO networking_nsxv3.common.synchronization [None req-55b11250-bd06-48a5-9863-3904740f3991 None None] Enqueued Resource ID: b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a with Priority: HIGHEST for action port [ 730.294328] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a with Priority: HIGHEST for action port [ 730.295549] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.295758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.296482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.296482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.296482] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.647764] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.647960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.648103] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25e1ce3d-f01e-4485-b5b5-73dd8e468523 with status ACTIVE [ 730.648331] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.648450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.648518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.648723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.648807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.648981] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.649088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.649143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.649294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.649368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.649541] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.649633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.649692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.649825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.649897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.649981] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25e1ce3d-f01e-4485-b5b5-73dd8e468523 is going to be updated. [ 730.654981] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.674845] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.674845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.674845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.675106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.675191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.675351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25e1ce3d-f01e-4485-b5b5-73dd8e468523" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.800519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a [ 730.800754] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.800887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.800957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.801322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.801322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.801445] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a already deleted. [ 730.801598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b69cd1dc-65fa-44f7-b6a3-daf4a9b3308a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.816808] env[69238]: INFO networking_nsxv3.common.synchronization [req-bd459646-26ce-479a-8e43-3b8064b09373 req-bebfc9ef-b1f9-48be-a1ce-d4154e035979 tempest-ServerDiagnosticsTest-275767881 tempest-ServerDiagnosticsTest-275767881-project-member] Enqueued Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_members [ 730.817349] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGHEST for action security_group_members [ 730.817648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.817768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.817832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.818773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.818773] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.818773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.818773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.818773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.818773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.819076] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.949723] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: SUCCESS [ 730.949842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.950791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.950951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.951056] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.156301] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.321275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.321488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.321533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.321915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.321915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.322195] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.322303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.322387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.322543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.322627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.322718] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea is going to be updated. [ 731.368501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.368705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.368705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.368841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.369127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.383055] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea in Status: IN_PROGRESS for 2s [ 731.457525] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.457525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.661180] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.661380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.661496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.661798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.662957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.662957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf is going to be created. [ 731.666035] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d7b52365-2795-47d1-968a-d5a88c8a9a48 tempest-ServersV294TestFqdnHostnames-1544691138 tempest-ServersV294TestFqdnHostnames-1544691138-project-member] Enqueued Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_rules [ 731.666901] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_rules [ 731.668932] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.669199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.669589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.669834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.669834] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.709218] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.709657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.710052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.710374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.710710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.733925] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: UNINITIALIZED for 2s [ 731.830390] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5e903fc7-0ea4-413c-87aa-f35f82a98513 tempest-ServersV294TestFqdnHostnames-1544691138 tempest-ServersV294TestFqdnHostnames-1544691138-project-member] Enqueued Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_rules [ 731.831264] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_rules [ 731.831702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.831853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.869461] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: SUCCESS [ 731.869461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.869696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.869747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.869899] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.870033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.870115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.871042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.871042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.871042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.871042] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.086211] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5dda6430-811c-42b3-bbc9-7a044a98eb04 None None] Enqueued Resource ID: c12126ba-3349-4e4a-be89-0f2b900e4057 with Priority: HIGHEST for action port [ 732.088316] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c12126ba-3349-4e4a-be89-0f2b900e4057 with Priority: HIGHEST for action port [ 732.088897] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c12126ba-3349-4e4a-be89-0f2b900e4057 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.088897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c12126ba-3349-4e4a-be89-0f2b900e4057" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.088897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c12126ba-3349-4e4a-be89-0f2b900e4057" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.090938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c12126ba-3349-4e4a-be89-0f2b900e4057" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.090938] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c12126ba-3349-4e4a-be89-0f2b900e4057',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.200931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.204156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.204156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.204156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.204156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.204156] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d84f347-c5bd-4943-8736-772c25927665 already deleted. [ 732.204156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.204156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.204156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.204156] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.376599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.376599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.376599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.376599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.376599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.377237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.377237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.377237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.377237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.377237] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.594825] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c12126ba-3349-4e4a-be89-0f2b900e4057 [ 732.595092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.595245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.595356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.595524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.595823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.595823] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c12126ba-3349-4e4a-be89-0f2b900e4057 already deleted. [ 732.595823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c12126ba-3349-4e4a-be89-0f2b900e4057" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.735383] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.735383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.735383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.735383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.735383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.735383] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d84f347-c5bd-4943-8736-772c25927665 already deleted. [ 732.735383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.880070] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aee600fe-2d5e-4376-8f72-81cf57665aed: rpc.has_security_group_logging(os_id): False [ 732.899028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.899353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.899426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.899640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.899762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.900084] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.900462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.900581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.900796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.901136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.901857] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.901943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.902094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.903311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.903443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.903667] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.903796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.903879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.904969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.905127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.905237] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed is going to be updated. [ 732.936203] env[69238]: INFO networking_nsxv3.common.synchronization [req-80fda123-03da-4765-8bd9-d1b805e6bcfe req-b0e3accb-82f5-47fb-a02e-7257e9db7fea tempest-ServersWithSpecificFlavorTestJSON-1275212292 tempest-ServersWithSpecificFlavorTestJSON-1275212292-project-member] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 732.936203] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 732.937908] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.938291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.939070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.939347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.939541] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.939649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.939715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.939912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.939974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.940086] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.969029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.969180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.969270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.969546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.969706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.984812] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: IN_PROGRESS for 2s [ 733.397179] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea in Status: SUCCESS [ 733.397179] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea deletion is rescheduled due to dependency. [ 733.397454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.444279] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.444927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.445062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.445313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.445418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.445629] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.445743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.445802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.445953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.446040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.446124] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 already deleted. [ 733.446204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.503728] env[69238]: INFO networking_nsxv3.common.synchronization [req-9170a30d-1846-4e01-b741-ce02d1b81ccc req-046ee82a-7d38-4aca-a0c0-652bcb4dde56 tempest-SecurityGroupRulesTestJSON-1952308625 tempest-SecurityGroupRulesTestJSON-1952308625-project-member] Enqueued Resource ID: 6331e158-ba35-425a-aa53-cc94ee734589 with Priority: HIGHEST for action security_group_rules [ 733.503728] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6331e158-ba35-425a-aa53-cc94ee734589 with Priority: HIGHEST for action security_group_rules [ 733.503728] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6331e158-ba35-425a-aa53-cc94ee734589 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.503728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6331e158-ba35-425a-aa53-cc94ee734589" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.503728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6331e158-ba35-425a-aa53-cc94ee734589" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.503728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6331e158-ba35-425a-aa53-cc94ee734589" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.503728] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6331e158-ba35-425a-aa53-cc94ee734589',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.604924] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.604924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.604924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.604924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.605437] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.605758] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.605993] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.606328] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.606697] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.608765] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.608765] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.608765] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.608765] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.608765] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.608765] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.608765] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.629886] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.630071] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.630205] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.630392] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.630900] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-40d99029-aa2f-4913-bac5-9265a102f92a taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.631143] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.631234] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.631568] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.631751] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40d99029-aa2f-4913-bac5-9265a102f92a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.750988] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: SUCCESS [ 733.751242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.751412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.751631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.751823] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.751941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.752026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.752219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.752310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.752381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.752496] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.031534] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.031534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.031534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.031534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.031534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.031534] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6331e158-ba35-425a-aa53-cc94ee734589 already deleted. [ 734.031534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6331e158-ba35-425a-aa53-cc94ee734589" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.135688] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.135900] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.136046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.136354] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.136562] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.136794] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 40d99029-aa2f-4913-bac5-9265a102f92a not found, creating... [ 734.137076] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.137283] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.137387] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.137632] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.137801] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.141771] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.142146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.142288] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.142556] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.142925] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.142925] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 40d99029-aa2f-4913-bac5-9265a102f92a is going to be created. [ 734.166237] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.166491] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.166645] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.166924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.167229] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.167450] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.257611] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.377134] env[69238]: INFO networking_nsxv3.common.synchronization [req-27e13618-aad3-416a-8166-1502861344a4 req-34524d1d-74d2-4bb6-858a-292e402b5269 tempest-ServerDiagnosticsNegativeTest-479324342 tempest-ServerDiagnosticsNegativeTest-479324342-project-member] Enqueued Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_members [ 734.377593] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 with Priority: HIGHEST for action security_group_members [ 734.378325] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e00b7de-bd62-4244-a65e-9ce263afed97 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.378325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.379132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.381197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.381197] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.381197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.381197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.381197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.381197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.381197] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e00b7de-bd62-4244-a65e-9ce263afed97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.764229] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18ed08a2-cdfd-4978-a1e0-e54baa6accdf: rpc.has_security_group_logging(os_id): False [ 734.787066] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.787524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.787524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.787769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.787850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.788133] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.788240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.788305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.788509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.788597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.788693] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf is going to be created. [ 734.883558] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.883776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.883951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.884268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.884524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.890036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.890036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.890036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.890036] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 is going to be updated. [ 734.903660] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: IN_PROGRESS for 2s [ 734.931709] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.931882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.931930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.932242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.932388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.956886] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 in Status: IN_PROGRESS for 2s [ 735.003041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: SUCCESS [ 735.003041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.282429] env[69238]: INFO networking_nsxv3.common.synchronization [req-80fda123-03da-4765-8bd9-d1b805e6bcfe req-f3b68088-32f3-4fa0-a4a3-206cadf81478 service nova] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 735.282601] env[69238]: INFO networking_nsxv3.common.synchronization [req-80fda123-03da-4765-8bd9-d1b805e6bcfe req-f3b68088-32f3-4fa0-a4a3-206cadf81478 service nova] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 735.282739] env[69238]: INFO networking_nsxv3.common.synchronization [req-80fda123-03da-4765-8bd9-d1b805e6bcfe req-f3b68088-32f3-4fa0-a4a3-206cadf81478 service nova] Enqueued Resource ID: 40d99029-aa2f-4913-bac5-9265a102f92a with Priority: HIGHEST for action port [ 735.282980] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 735.283128] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 735.283266] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40d99029-aa2f-4913-bac5-9265a102f92a with Priority: HIGHEST for action port [ 735.283875] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.283941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.284011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.288523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.288627] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.289882] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.290057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.290556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.290812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.291025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.291171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.291259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.291442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.291556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.291657] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.292855] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-40d99029-aa2f-4913-bac5-9265a102f92a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.293035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.293121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.293326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.293490] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40d99029-aa2f-4913-bac5-9265a102f92a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.796148] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.798540] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.799057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.799900] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40d99029-aa2f-4913-bac5-9265a102f92a with status ACTIVE [ 735.800275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.800407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.800498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.800713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.800804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.800982] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.801098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.801162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.801315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.801390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.801575] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.801674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.801736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.801882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.801956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.802063] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40d99029-aa2f-4913-bac5-9265a102f92a is going to be updated. [ 735.828237] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.828408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.828487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.828678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.828851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.829020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40d99029-aa2f-4913-bac5-9265a102f92a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.300896] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.470631] env[69238]: INFO networking_nsxv3.common.synchronization [req-69828a69-4ab7-443c-a0e5-fe5aae39573a req-f7cd10aa-9184-41db-8083-e5e9a52371da tempest-SecurityGroupRulesTestJSON-1952308625 tempest-SecurityGroupRulesTestJSON-1952308625-project-member] Enqueued Resource ID: 178c44c2-6d9e-4ca0-bb4f-ade6a76849ce with Priority: HIGHEST for action security_group_rules [ 736.470631] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 178c44c2-6d9e-4ca0-bb4f-ade6a76849ce with Priority: HIGHEST for action security_group_rules [ 736.474416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-178c44c2-6d9e-4ca0-bb4f-ade6a76849ce taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.474416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-178c44c2-6d9e-4ca0-bb4f-ade6a76849ce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.474416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-178c44c2-6d9e-4ca0-bb4f-ade6a76849ce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.474416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-178c44c2-6d9e-4ca0-bb4f-ade6a76849ce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.474416] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('178c44c2-6d9e-4ca0-bb4f-ade6a76849ce',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.805696] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.806080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.806080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.806306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.806700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.806790] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 is going to be created. [ 736.854215] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.855333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.855333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.855333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.855333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.873669] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: UNINITIALIZED for 2s [ 736.930464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: SUCCESS [ 736.932339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.971405] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 in Status: SUCCESS [ 736.971686] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e00b7de-bd62-4244-a65e-9ce263afed97 deletion is rescheduled due to dependency. [ 736.971861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e00b7de-bd62-4244-a65e-9ce263afed97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.003625] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.003804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.003852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.004072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.005024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.005024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 178c44c2-6d9e-4ca0-bb4f-ade6a76849ce already deleted. [ 737.005024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-178c44c2-6d9e-4ca0-bb4f-ade6a76849ce" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.610685] env[69238]: INFO networking_nsxv3.common.synchronization [None req-81ac09cb-eaf7-44a9-a5e6-f84bfd284c80 None None] Enqueued Resource ID: 0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167 with Priority: HIGHEST for action port [ 737.610685] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167 with Priority: HIGHEST for action port [ 737.610888] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.610888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.610976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.611919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.611919] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.117438] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167 [ 738.117748] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.117893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.117964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.118229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.118325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.118424] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167 already deleted. [ 738.118507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e4bb28f-bcb2-4f6d-8802-1ea5bb2a7167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.152493] env[69238]: INFO networking_nsxv3.common.synchronization [req-bacb417b-88d3-4b01-b414-2662cfb1488d req-ce92c270-ae34-4c9f-bdbc-77734cdb038d tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 738.153017] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 738.153365] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.153496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.153556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.153802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.153957] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.154070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.154137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.154332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.154427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.154517] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.625347] env[69238]: INFO networking_nsxv3.common.synchronization [req-dbd79e75-8e2e-4f46-86b2-214d5d672008 req-0337410f-fc18-44fb-ab07-1a77f52a6040 tempest-FloatingIPsAssociationNegativeTestJSON-2103775561 tempest-FloatingIPsAssociationNegativeTestJSON-2103775561-project-member] Enqueued Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_members [ 738.626060] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGHEST for action security_group_members [ 738.626299] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.626426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.626489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.626722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.628958] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.628958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.628958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.628958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.628958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.628958] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.657707] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.657707] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.657707] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 already deleted. [ 738.657707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.886021] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: SUCCESS [ 738.886021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.886021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.886021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.886021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.886021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.886021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.886021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.887453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.887765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.888135] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.129282] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.129618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.129618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.130135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.130229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.130476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.130636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.130726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.131130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.131243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.131393] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2d26f8-cf66-400c-8b21-810887d32724 is going to be updated. [ 739.162273] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.162497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.162602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.162842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.163011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.174422] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2d26f8-cf66-400c-8b21-810887d32724 in Status: IN_PROGRESS for 2s [ 739.190388] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.190639] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.190766] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.191160] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.191493] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.191667] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.191787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.192015] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.193790] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.194762] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.194934] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.195246] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.195246] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.196325] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.196527] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.196712] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.232025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.232238] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 739.232382] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.232561] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.232897] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-8de000ab-efa4-4d31-a340-abab444c7ea3 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.233085] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.233206] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.233548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.233715] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de000ab-efa4-4d31-a340-abab444c7ea3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.390487] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.737567] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.738269] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.738546] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.738896] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.739193] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.739449] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 8de000ab-efa4-4d31-a340-abab444c7ea3 not found, creating... [ 739.739771] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.739946] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.740239] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.740591] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.740591] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.740924] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.741832] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.742055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.742455] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.742838] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.744436] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 8de000ab-efa4-4d31-a340-abab444c7ea3 is going to be created. [ 739.770229] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.770482] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.770619] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.770999] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.771301] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.771837] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.895714] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6b0ebb8-e601-44fa-aac4-0c8f25377737: rpc.has_security_group_logging(os_id): False [ 739.924192] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.924555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.924555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.924703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.924735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.925987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.925987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.925987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.925987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.925987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.925987] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 is going to be created. [ 739.997262] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.997469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.997469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.997714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.998094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.026027] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: IN_PROGRESS for 2s [ 740.463759] env[69238]: INFO networking_nsxv3.common.synchronization [None req-367a1a81-faf4-4f11-a554-4d63b166b66c None None] Enqueued Resource ID: 90e2fada-0e63-4ff9-9c28-423886e3c08b with Priority: HIGHEST for action port [ 740.464761] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e2fada-0e63-4ff9-9c28-423886e3c08b with Priority: HIGHEST for action port [ 740.464951] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-90e2fada-0e63-4ff9-9c28-423886e3c08b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.464951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90e2fada-0e63-4ff9-9c28-423886e3c08b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.465119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90e2fada-0e63-4ff9-9c28-423886e3c08b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.466083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90e2fada-0e63-4ff9-9c28-423886e3c08b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.466132] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90e2fada-0e63-4ff9-9c28-423886e3c08b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.643641] env[69238]: INFO networking_nsxv3.common.synchronization [None req-759f2653-aaa1-4d14-91b3-d9ea984740cf None None] Enqueued Resource ID: d4b4baaa-8954-48ca-8b27-9a4f7d5badcf with Priority: HIGHEST for action port [ 740.643981] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4b4baaa-8954-48ca-8b27-9a4f7d5badcf with Priority: HIGHEST for action port [ 740.644675] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4b4baaa-8954-48ca-8b27-9a4f7d5badcf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.644849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4b4baaa-8954-48ca-8b27-9a4f7d5badcf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.645150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4b4baaa-8954-48ca-8b27-9a4f7d5badcf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.645448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4b4baaa-8954-48ca-8b27-9a4f7d5badcf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.645564] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4b4baaa-8954-48ca-8b27-9a4f7d5badcf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.970108] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90e2fada-0e63-4ff9-9c28-423886e3c08b [ 740.970754] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.970754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.970754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.970754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.970945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.970945] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90e2fada-0e63-4ff9-9c28-423886e3c08b already deleted. [ 740.971015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90e2fada-0e63-4ff9-9c28-423886e3c08b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.151199] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4b4baaa-8954-48ca-8b27-9a4f7d5badcf [ 741.151199] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.151364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.151422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.151815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.151815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.151815] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4b4baaa-8954-48ca-8b27-9a4f7d5badcf already deleted. [ 741.151918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4b4baaa-8954-48ca-8b27-9a4f7d5badcf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.190674] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2d26f8-cf66-400c-8b21-810887d32724 in Status: SUCCESS [ 741.190852] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2d26f8-cf66-400c-8b21-810887d32724 deletion is rescheduled due to dependency. [ 741.192541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.468153] env[69238]: INFO networking_nsxv3.common.synchronization [req-bacb417b-88d3-4b01-b414-2662cfb1488d req-347550cb-f2db-4871-add2-588003d7fc27 service nova] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_rules [ 741.468153] env[69238]: INFO networking_nsxv3.common.synchronization [req-bacb417b-88d3-4b01-b414-2662cfb1488d req-347550cb-f2db-4871-add2-588003d7fc27 service nova] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 741.468536] env[69238]: INFO networking_nsxv3.common.synchronization [req-bacb417b-88d3-4b01-b414-2662cfb1488d req-347550cb-f2db-4871-add2-588003d7fc27 service nova] Enqueued Resource ID: 8de000ab-efa4-4d31-a340-abab444c7ea3 with Priority: HIGHEST for action port [ 741.469511] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_rules [ 741.469511] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 741.471060] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de000ab-efa4-4d31-a340-abab444c7ea3 with Priority: HIGHEST for action port [ 741.473043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.473043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.473043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.473043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.473043] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.473594] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.473594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.473594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.473594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.473742] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.473742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.473815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.475811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.475811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.475811] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.478739] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-8de000ab-efa4-4d31-a340-abab444c7ea3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.478877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.479228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.483445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.483445] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de000ab-efa4-4d31-a340-abab444c7ea3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.981674] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.982843] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.982980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.990247] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8de000ab-efa4-4d31-a340-abab444c7ea3 with status ACTIVE [ 741.990247] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.990247] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.990247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.990247] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.990999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.990999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.990999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.990999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.990999] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8de000ab-efa4-4d31-a340-abab444c7ea3 is going to be updated. [ 742.017876] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.017964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.018036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.018265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.018691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.018691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8de000ab-efa4-4d31-a340-abab444c7ea3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.036212] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: SUCCESS [ 742.036352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.397112] env[69238]: INFO networking_nsxv3.common.synchronization [req-eda2d8ac-1970-41eb-b099-c8910d43e3d8 req-d3153932-4092-4f0f-9ee6-472b6770fa0b tempest-ImagesNegativeTestJSON-635333992 tempest-ImagesNegativeTestJSON-635333992-project-member] Enqueued Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_members [ 742.397112] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_members [ 742.397112] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.397112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.399099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.399525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.403351] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.403351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.403351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.403351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.403351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.403351] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.484426] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.505863] env[69238]: INFO networking_nsxv3.common.synchronization [req-ec8b3f10-d07c-41cc-9ec1-3d93e4f90a71 req-d945dd36-1bb6-4a2b-848f-13a3f089ca91 tempest-SecurityGroupRulesTestJSON-1952308625 tempest-SecurityGroupRulesTestJSON-1952308625-project-member] Enqueued Resource ID: 5ae864b8-1b8b-43c3-b76f-45a1e5001833 with Priority: HIGHEST for action security_group_rules [ 742.506504] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae864b8-1b8b-43c3-b76f-45a1e5001833 with Priority: HIGHEST for action security_group_rules [ 742.509873] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ae864b8-1b8b-43c3-b76f-45a1e5001833 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.509873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ae864b8-1b8b-43c3-b76f-45a1e5001833" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.509873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ae864b8-1b8b-43c3-b76f-45a1e5001833" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.509873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ae864b8-1b8b-43c3-b76f-45a1e5001833" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.509873] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ae864b8-1b8b-43c3-b76f-45a1e5001833',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.902839] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.904275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.904275] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 already deleted. [ 742.904275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.988532] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.988730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.988795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.988982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.989086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.989183] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be created. [ 743.015435] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.015585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.015585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.015799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.015955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.019255] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.019435] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-479" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.019555] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-479" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.019858] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-479" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.020125] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.020286] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.020508] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.020606] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.020748] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.020949] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.021108] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.021177] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.021285] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.021393] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.021494] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.021623] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.027422] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: UNINITIALIZED for 2s [ 743.035554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.035701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.035766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.035988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.036099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.036197] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ae864b8-1b8b-43c3-b76f-45a1e5001833 already deleted. [ 743.036338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ae864b8-1b8b-43c3-b76f-45a1e5001833" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.049595] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.049840] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.050032] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.050180] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-479" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.050517] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.050833] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.050976] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.052999] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.052999] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ec4c3e0-a83e-4884-9324-7fe9faa2aad3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.459480] env[69238]: INFO networking_nsxv3.common.synchronization [None req-307aea4c-c45d-412b-bc69-bfd23d5554db None None] Enqueued Resource ID: 1f8fb00a-8f09-47d6-8e49-7d24806215a4 with Priority: HIGHEST for action port [ 743.461789] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8fb00a-8f09-47d6-8e49-7d24806215a4 with Priority: HIGHEST for action port [ 743.462071] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f8fb00a-8f09-47d6-8e49-7d24806215a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.462569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f8fb00a-8f09-47d6-8e49-7d24806215a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.464199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f8fb00a-8f09-47d6-8e49-7d24806215a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.464199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f8fb00a-8f09-47d6-8e49-7d24806215a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.464406] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8fb00a-8f09-47d6-8e49-7d24806215a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.554656] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.555048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.555048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.555412] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.555583] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.555742] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 not found, creating... [ 743.556021] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.556254] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.557045] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.557045] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.557243] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.557631] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.558023] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.558190] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.558493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.558679] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.558850] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 is going to be created. [ 743.582961] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.583202] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.583707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.583707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.584087] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.584399] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.967451] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f8fb00a-8f09-47d6-8e49-7d24806215a4 [ 743.967703] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.967847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.967907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.968163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.968231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.968387] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f8fb00a-8f09-47d6-8e49-7d24806215a4 already deleted. [ 743.968440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f8fb00a-8f09-47d6-8e49-7d24806215a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.039388] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 745.039687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.039873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.040084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.040337] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.040552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.040552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.040716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.040814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.040909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.040997] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.115952] env[69238]: INFO networking_nsxv3.common.synchronization [req-eda2d8ac-1970-41eb-b099-c8910d43e3d8 req-4971f1e0-5c0f-4af4-ad08-bde5e74f89d8 service nova] Enqueued Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_rules [ 745.116088] env[69238]: INFO networking_nsxv3.common.synchronization [req-eda2d8ac-1970-41eb-b099-c8910d43e3d8 req-4971f1e0-5c0f-4af4-ad08-bde5e74f89d8 service nova] Enqueued Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_members [ 745.116238] env[69238]: INFO networking_nsxv3.common.synchronization [req-eda2d8ac-1970-41eb-b099-c8910d43e3d8 req-4971f1e0-5c0f-4af4-ad08-bde5e74f89d8 service nova] Enqueued Resource ID: 0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 with Priority: HIGHEST for action port [ 745.116909] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_rules [ 745.117135] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_members [ 745.117252] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 with Priority: HIGHEST for action port [ 745.117553] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.117685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.117757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.118102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.118927] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.120917] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.121165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.121289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.121463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.121641] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.121749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.121811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.121990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.122084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.122220] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.123180] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.123301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.123420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.123537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.123616] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ec4c3e0-a83e-4884-9324-7fe9faa2aad3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.543638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.543794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.543872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.544129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.544351] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.544466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.544533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.544690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.544783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.544871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.545029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.545123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.545183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.545348] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.545486] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.545577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.545635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.545772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.545863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.545943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.546040] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.580360] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff1ca9ce-7c2e-4c8a-8c45-bc531ca66da8 req-845b6e33-193e-4447-9c8d-03b23bc6dc74 tempest-ServersAdminNegativeTestJSON-838199429 tempest-ServersAdminNegativeTestJSON-838199429-project-member] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 745.580877] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 745.581182] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.581300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.581462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.581553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.581695] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.581790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.581850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.581995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.586367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.586501] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.625114] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.626124] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.626224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.626403] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 with status ACTIVE [ 745.626553] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.626683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.626755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.626955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.627079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.627216] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.627316] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.627374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.627673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.627759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.627937] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.630494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.630494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.630494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.630494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.630494] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ec4c3e0-a83e-4884-9324-7fe9faa2aad3 is going to be updated. [ 745.658501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.658651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.658722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.658930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.659082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.659245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ec4c3e0-a83e-4884-9324-7fe9faa2aad3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.048861] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2: rpc.has_security_group_logging(os_id): False [ 746.067738] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.067738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.067738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.067738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.067738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.067738] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.067738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.067738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.068121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.068121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.068121] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.068355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.068355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.069840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.069840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.069840] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.069840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.069840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.069840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.069840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.069840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be created. [ 746.089297] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.131990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.132142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.132300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.135178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.135178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.135178] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.144874] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 746.393248] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.393248] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.393248] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.393458] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.393847] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.393956] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.393999] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.394679] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.394908] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.395078] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.395874] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.395973] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.396661] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.396825] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.397062] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.397229] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.424640] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.424914] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.424988] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.425148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.425498] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-907be0e4-f22b-45e4-9fc0-2da03328be1b taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.425719] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.425895] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.426649] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.427114] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('907be0e4-f22b-45e4-9fc0-2da03328be1b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.477517] env[69238]: INFO networking_nsxv3.common.synchronization [req-37dc7adc-d155-436d-8baf-3d8b191f4c9e req-51c8fb5f-7b77-485a-bf9a-5f3f8a34b77d tempest-SecurityGroupRulesTestJSON-1952308625 tempest-SecurityGroupRulesTestJSON-1952308625-project-member] Enqueued Resource ID: 4cf6d6d1-bc85-4add-9a7d-dc7e1342a543 with Priority: HIGHEST for action security_group_rules [ 746.478345] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf6d6d1-bc85-4add-9a7d-dc7e1342a543 with Priority: HIGHEST for action security_group_rules [ 746.478680] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cf6d6d1-bc85-4add-9a7d-dc7e1342a543 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.478947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cf6d6d1-bc85-4add-9a7d-dc7e1342a543" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.478947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cf6d6d1-bc85-4add-9a7d-dc7e1342a543" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.479291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cf6d6d1-bc85-4add-9a7d-dc7e1342a543" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.479430] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cf6d6d1-bc85-4add-9a7d-dc7e1342a543',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.594780] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.637378] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.637631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.637709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.637930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.638029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.638125] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 is going to be created. [ 746.670616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.670785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.670903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.671085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.671257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.685800] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 in Status: UNINITIALIZED for 2s [ 746.934055] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.934055] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 907be0e4-f22b-45e4-9fc0-2da03328be1b not found, creating... [ 746.934055] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.934055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.934850] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.934850] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.934850] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.934850] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.934850] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.934850] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 907be0e4-f22b-45e4-9fc0-2da03328be1b is going to be created. [ 746.963481] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.963890] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.964107] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.964523] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.965040] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.965334] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.002034] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.002300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.002376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.002729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.002779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.002875] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cf6d6d1-bc85-4add-9a7d-dc7e1342a543 already deleted. [ 747.003344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cf6d6d1-bc85-4add-9a7d-dc7e1342a543" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.099966] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.101264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.101264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.101264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.101264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.101264] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be updated. [ 747.133355] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.133521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.133567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.133776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.134247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.155164] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: IN_PROGRESS for 2s [ 747.634287] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3d34aee-1e49-44c5-8424-72bf6c682006 req-99063cc9-2288-4d88-9766-6dd988b21906 tempest-ServersTestFqdnHostnames-543136473 tempest-ServersTestFqdnHostnames-543136473-project-member] Enqueued Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_members [ 747.634897] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_members [ 747.635217] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3efc2ce-5009-447c-a310-4d3178a7395c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.635482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.635550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.635906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.635964] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.636081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.636341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.636341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.636341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.636534] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.907025] env[69238]: INFO networking_nsxv3.common.synchronization [None req-53a27705-53a5-4887-9bb6-815c8fa877f4 None None] Enqueued Resource ID: 4e7a7005-98ee-4242-af38-2e4fb43fb041 with Priority: HIGHEST for action port [ 747.907025] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e7a7005-98ee-4242-af38-2e4fb43fb041 with Priority: HIGHEST for action port [ 747.907025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e7a7005-98ee-4242-af38-2e4fb43fb041 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.907025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e7a7005-98ee-4242-af38-2e4fb43fb041" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.907025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e7a7005-98ee-4242-af38-2e4fb43fb041" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.907025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e7a7005-98ee-4242-af38-2e4fb43fb041" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.907025] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e7a7005-98ee-4242-af38-2e4fb43fb041',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.982737] env[69238]: INFO networking_nsxv3.common.synchronization [None req-2033799b-7f0a-45e5-b238-e53c303f7025 None None] Enqueued Resource ID: 2481e076-027a-4d4a-a3f7-9c6daa95b446 with Priority: HIGHEST for action port [ 747.982737] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2481e076-027a-4d4a-a3f7-9c6daa95b446 with Priority: HIGHEST for action port [ 747.982737] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-2481e076-027a-4d4a-a3f7-9c6daa95b446 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.982737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2481e076-027a-4d4a-a3f7-9c6daa95b446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.982737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2481e076-027a-4d4a-a3f7-9c6daa95b446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.982737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2481e076-027a-4d4a-a3f7-9c6daa95b446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.982737] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2481e076-027a-4d4a-a3f7-9c6daa95b446',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.138549] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.139011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.139011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.139380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.139877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.139877] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.139877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.140144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.141559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.141559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.141559] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3efc2ce-5009-447c-a310-4d3178a7395c already deleted. [ 748.141559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.165064] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 748.165334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.414566] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e7a7005-98ee-4242-af38-2e4fb43fb041 [ 748.415421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.415421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.416098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.416215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.416404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.416603] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e7a7005-98ee-4242-af38-2e4fb43fb041 already deleted. [ 748.418265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e7a7005-98ee-4242-af38-2e4fb43fb041" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.433122] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff1ca9ce-7c2e-4c8a-8c45-bc531ca66da8 req-390f82b0-1a83-45aa-909c-e7ff02b0f9fc service nova] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_rules [ 748.433302] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff1ca9ce-7c2e-4c8a-8c45-bc531ca66da8 req-390f82b0-1a83-45aa-909c-e7ff02b0f9fc service nova] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 748.433625] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff1ca9ce-7c2e-4c8a-8c45-bc531ca66da8 req-390f82b0-1a83-45aa-909c-e7ff02b0f9fc service nova] Enqueued Resource ID: 907be0e4-f22b-45e4-9fc0-2da03328be1b with Priority: HIGHEST for action port [ 748.433867] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_rules [ 748.433997] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 748.434111] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907be0e4-f22b-45e4-9fc0-2da03328be1b with Priority: HIGHEST for action port [ 748.438950] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.439127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.439218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.439489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.439612] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.442063] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.442176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.442391] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-907be0e4-f22b-45e4-9fc0-2da03328be1b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.442491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.442555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.442750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.443670] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('907be0e4-f22b-45e4-9fc0-2da03328be1b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.483865] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2481e076-027a-4d4a-a3f7-9c6daa95b446 [ 748.484688] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.484864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.484913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.485177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.485251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.485330] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2481e076-027a-4d4a-a3f7-9c6daa95b446 already deleted. [ 748.485394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2481e076-027a-4d4a-a3f7-9c6daa95b446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.676256] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-231 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.676256] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-231" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.676256] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-231" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.676506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-231" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.677118] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.677370] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.677498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.677723] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.677873] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.678103] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.678260] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.678356] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.678476] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.679631] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.679631] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.679631] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.696542] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 in Status: SUCCESS [ 748.697420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.697997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.698245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.698450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.698573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.698640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.698793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.699882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.700175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.700175] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.705204] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.705204] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.705204] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.705204] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-231" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.705204] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-25b13ee6-214f-4351-92de-445c18a83da1 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.705204] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.705204] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.705204] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.705204] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25b13ee6-214f-4351-92de-445c18a83da1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.946569] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.946569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.947529] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 907be0e4-f22b-45e4-9fc0-2da03328be1b with status ACTIVE [ 748.950314] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.950494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.950563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.950956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.950956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.951167] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.951167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.951167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.951380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.951380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.952177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.952177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.952177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.952177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.952177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.952177] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 907be0e4-f22b-45e4-9fc0-2da03328be1b is going to be updated. [ 748.976280] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.976456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.976512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.976894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.977397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.977602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-907be0e4-f22b-45e4-9fc0-2da03328be1b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.170629] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: SUCCESS [ 749.170629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.170629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.171240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.171240] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.171240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.171240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.171240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.171240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.172504] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.207229] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.207576] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.208707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.208707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.208957] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.209060] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 25b13ee6-214f-4351-92de-445c18a83da1 not found, creating... [ 749.209320] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.209586] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.209862] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.209862] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.210111] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.210348] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.210511] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.210628] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.215984] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.215984] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.215984] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 25b13ee6-214f-4351-92de-445c18a83da1 is going to be created. [ 749.218019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.218019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.218019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.218019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.218019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.218019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.218019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.221495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.221495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.221495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.221495] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.248184] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.249964] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.249964] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.249964] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.249964] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.249964] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.677139] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.724894] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6: rpc.has_security_group_logging(os_id): False [ 749.747289] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.747289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.747289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.747289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.747289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.747289] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.747289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.747289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.747591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.747591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.747591] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.747797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.747797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.747896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.748074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.748308] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.748411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.748633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.748633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.748697] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.748811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 is going to be created. [ 749.769897] env[69238]: INFO networking_nsxv3.common.synchronization [req-bdca7f90-2ce7-4a39-869c-8a4400580c48 req-9b49f58d-ddb1-45c7-b688-6bd60eb1a703 tempest-SecurityGroupRulesTestJSON-1952308625 tempest-SecurityGroupRulesTestJSON-1952308625-project-member] Enqueued Resource ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf with Priority: HIGHEST for action security_group_rules [ 749.770140] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf with Priority: HIGHEST for action security_group_rules [ 749.770648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.770788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.772330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.772823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.772943] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f48a8c13-07d7-41fb-bda5-0d2d8f7623cf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.819162] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.819162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.820579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.820579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.820579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.835107] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 in Status: IN_PROGRESS for 2s [ 750.180087] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.302495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.302495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.303431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.303716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.303817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.303927] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf already deleted. [ 750.304887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.533433] env[69238]: INFO networking_nsxv3.common.synchronization [req-c41bb494-de2d-4456-ad57-059d49e99b36 req-f08714a4-a569-4611-9707-a604e9bc8990 tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 750.533848] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 750.534165] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.534292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.534388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.534624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.534801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.534908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.534973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.538688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.542220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.542220] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.655024] env[69238]: INFO networking_nsxv3.common.synchronization [None req-25495d64-52a2-47f4-8c25-336772336947 None None] Enqueued Resource ID: e299e41d-44d7-476a-9b45-c814bb1cc045 with Priority: HIGHEST for action port [ 750.655024] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e299e41d-44d7-476a-9b45-c814bb1cc045 with Priority: HIGHEST for action port [ 750.655024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-e299e41d-44d7-476a-9b45-c814bb1cc045 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.655024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e299e41d-44d7-476a-9b45-c814bb1cc045" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.655024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e299e41d-44d7-476a-9b45-c814bb1cc045" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.655365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e299e41d-44d7-476a-9b45-c814bb1cc045" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.655449] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e299e41d-44d7-476a-9b45-c814bb1cc045',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.687661] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.687959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.687959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.688246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.688346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.689024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be updated. [ 750.696729] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b3dc952b-bcc7-478f-888e-e75c1d2c622e None None] Enqueued Resource ID: 15db3f2d-adc3-41bb-918c-84c421d88ecd with Priority: HIGHEST for action port [ 750.697236] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15db3f2d-adc3-41bb-918c-84c421d88ecd with Priority: HIGHEST for action port [ 750.699835] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-15db3f2d-adc3-41bb-918c-84c421d88ecd taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.699835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15db3f2d-adc3-41bb-918c-84c421d88ecd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.699835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15db3f2d-adc3-41bb-918c-84c421d88ecd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.701742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15db3f2d-adc3-41bb-918c-84c421d88ecd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.701986] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15db3f2d-adc3-41bb-918c-84c421d88ecd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.721971] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.721971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.721971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.721971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.721971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.732675] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: IN_PROGRESS for 2s [ 750.943903] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3d34aee-1e49-44c5-8424-72bf6c682006 req-c72e1b83-193e-47b5-91b9-a4db0aa409e6 service nova] Enqueued Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_rules [ 750.943903] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3d34aee-1e49-44c5-8424-72bf6c682006 req-c72e1b83-193e-47b5-91b9-a4db0aa409e6 service nova] Enqueued Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_members [ 750.943903] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3d34aee-1e49-44c5-8424-72bf6c682006 req-c72e1b83-193e-47b5-91b9-a4db0aa409e6 service nova] Enqueued Resource ID: 25b13ee6-214f-4351-92de-445c18a83da1 with Priority: HIGHEST for action port [ 750.943903] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_rules [ 750.943903] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_members [ 750.943903] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b13ee6-214f-4351-92de-445c18a83da1 with Priority: HIGHEST for action port [ 750.944489] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3efc2ce-5009-447c-a310-4d3178a7395c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.944642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.944642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.944817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.944913] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.945981] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3efc2ce-5009-447c-a310-4d3178a7395c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.946104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.946168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.946543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.946810] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.946889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.946961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.947126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.947211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.947302] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.948053] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-25b13ee6-214f-4351-92de-445c18a83da1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.948275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.948389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.948522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.948565] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25b13ee6-214f-4351-92de-445c18a83da1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.044924] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.082982] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.083200] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.083338] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.083600] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.083856] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.084045] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.084251] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.084581] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.084779] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.085025] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.085349] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.085759] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.085759] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.085759] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.085913] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.085913] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.107873] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.108101] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.108262] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.108509] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.108965] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.109161] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.109279] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.109603] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.109741] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.159797] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e299e41d-44d7-476a-9b45-c814bb1cc045 [ 751.161829] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.161829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.161829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.161829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.161829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.161829] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e299e41d-44d7-476a-9b45-c814bb1cc045 already deleted. [ 751.161829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e299e41d-44d7-476a-9b45-c814bb1cc045" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.203405] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15db3f2d-adc3-41bb-918c-84c421d88ecd [ 751.203842] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.203842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.204014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.204204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.204295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.204356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15db3f2d-adc3-41bb-918c-84c421d88ecd already deleted. [ 751.204460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15db3f2d-adc3-41bb-918c-84c421d88ecd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.264436] env[69238]: INFO networking_nsxv3.common.synchronization [req-1dffe27d-549f-46b7-8984-f4d560f82373 req-26ddf72c-7c72-4a6b-9d00-b1961bfba765 tempest-SecurityGroupRulesTestJSON-1952308625 tempest-SecurityGroupRulesTestJSON-1952308625-project-member] Enqueued Resource ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf with Priority: HIGHEST for action security_group_rules [ 751.265986] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf with Priority: HIGHEST for action security_group_rules [ 751.266734] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.266897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.266994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.269197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.269323] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f48a8c13-07d7-41fb-bda5-0d2d8f7623cf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.450794] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.456080] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3efc2ce-5009-447c-a310-4d3178a7395c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.456080] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25b13ee6-214f-4351-92de-445c18a83da1 with status ACTIVE [ 751.456080] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.456080] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.456080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.456080] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.456969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.456969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.456969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.456969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.456969] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25b13ee6-214f-4351-92de-445c18a83da1 is going to be updated. [ 751.485445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.485653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.485704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.485900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.486320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.486320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25b13ee6-214f-4351-92de-445c18a83da1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.549629] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.614679] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.614679] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.614679] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.614926] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.615055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.615219] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 not found, creating... [ 751.615784] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.615784] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.615941] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.616099] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.616240] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.616528] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.616684] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.616929] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.617078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.617224] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.617372] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 is going to be created. [ 751.642866] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.643977] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.643977] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.643977] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.644860] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.645253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.792698] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.792798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.792839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.793085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.793486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.793486] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf already deleted. [ 751.793486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.847701] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 in Status: SUCCESS [ 751.848085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.959547] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.053249] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.053249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.053249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.053249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.054016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.054016] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 752.086087] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.086289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.086362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.086647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.086889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.096619] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 752.382110] env[69238]: INFO networking_nsxv3.common.synchronization [req-c41bb494-de2d-4456-ad57-059d49e99b36 req-1fc4bbc8-f727-4644-aac7-bb0ce4de4040 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 752.382110] env[69238]: INFO networking_nsxv3.common.synchronization [req-c41bb494-de2d-4456-ad57-059d49e99b36 req-1fc4bbc8-f727-4644-aac7-bb0ce4de4040 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 752.382110] env[69238]: INFO networking_nsxv3.common.synchronization [req-c41bb494-de2d-4456-ad57-059d49e99b36 req-1fc4bbc8-f727-4644-aac7-bb0ce4de4040 service nova] Enqueued Resource ID: 4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 with Priority: HIGHEST for action port [ 752.382110] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 752.382110] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 752.382110] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 with Priority: HIGHEST for action port [ 752.384756] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.384756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.384756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.385014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.385143] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.386150] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.386300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.389986] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.389986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.389986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.389986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.389986] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.467764] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.468014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.468191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.468373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.468373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.468530] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3efc2ce-5009-447c-a310-4d3178a7395c is going to be created. [ 752.495650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.495822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.495865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.496139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.496321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.508376] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3efc2ce-5009-447c-a310-4d3178a7395c in Status: UNINITIALIZED for 2s [ 752.745591] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: SUCCESS [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.745591] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.745591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.745591] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.888677] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.891403] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 with status ACTIVE [ 752.891403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.891403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.891403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.891403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.892187] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4 is going to be updated. [ 752.930385] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.930385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.930385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.930385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.930385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.930385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b2c8ee6-da56-4ba5-bfd9-e68ba7c63cc4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.249319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.249319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.249319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.249319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.249319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.249319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.249319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.249773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.249773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.249773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.249773] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.249922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.249922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.249988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.250144] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.250243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.250330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.250450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.250542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.250623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.250722] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.359603] env[69238]: INFO networking_nsxv3.common.synchronization [req-7b7a0e55-18e2-4735-988a-4e33180ae160 req-25632510-3833-4211-8a99-2ae0ccb8f1dc tempest-SecurityGroupRulesTestJSON-1952308625 tempest-SecurityGroupRulesTestJSON-1952308625-project-member] Enqueued Resource ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf with Priority: HIGHEST for action security_group_rules [ 753.360269] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf with Priority: HIGHEST for action security_group_rules [ 753.360638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.360828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.360828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.361076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.361166] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f48a8c13-07d7-41fb-bda5-0d2d8f7623cf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.755289] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd8c2d89-8008-4f6a-97b2-32f45c842cdf: rpc.has_security_group_logging(os_id): False [ 753.778163] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.778648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.778757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.779849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.779964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.782373] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.782373] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.782373] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.782373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.784351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.784351] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be updated. [ 753.887055] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.890596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.890779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.890960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.891153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.902698] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.902851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.902911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.903142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.903236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.903332] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f48a8c13-07d7-41fb-bda5-0d2d8f7623cf already deleted. [ 753.903413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f48a8c13-07d7-41fb-bda5-0d2d8f7623cf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.917781] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: IN_PROGRESS for 2s [ 754.111017] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 754.111017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.111017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.111017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.111017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.111017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.111017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.111017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.111017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.111017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.521134] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3efc2ce-5009-447c-a310-4d3178a7395c in Status: SUCCESS [ 754.521375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.521733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.521783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.521953] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.522230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.522230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.522399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.522474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.522793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.522894] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.615503] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.029031] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.121878] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.528967] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3efc2ce-5009-447c-a310-4d3178a7395c: rpc.has_security_group_logging(os_id): False [ 755.551763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.551763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.551763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.551763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.551763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.552132] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.552451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.552451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.552569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.554213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.554417] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3efc2ce-5009-447c-a310-4d3178a7395c is going to be created. [ 755.627920] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.627920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.628218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.628281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.628365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.628480] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 755.640858] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.641026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.641107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.641326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.641540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.655187] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3efc2ce-5009-447c-a310-4d3178a7395c in Status: IN_PROGRESS for 2s [ 755.697142] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.697142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.697142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.697142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.697142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.720854] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 755.940189] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: SUCCESS [ 755.940189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.593186] env[69238]: INFO networking_nsxv3.common.synchronization [None req-523fe273-bda8-4922-b493-32f33e68d3cc None None] Enqueued Resource ID: 3fa01d5d-769a-414f-bcca-45275aa4a90e with Priority: HIGHEST for action port [ 756.593546] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa01d5d-769a-414f-bcca-45275aa4a90e with Priority: HIGHEST for action port [ 756.594098] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fa01d5d-769a-414f-bcca-45275aa4a90e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.594214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fa01d5d-769a-414f-bcca-45275aa4a90e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.594374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fa01d5d-769a-414f-bcca-45275aa4a90e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.594543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fa01d5d-769a-414f-bcca-45275aa4a90e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.594628] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa01d5d-769a-414f-bcca-45275aa4a90e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.027475] env[69238]: INFO networking_nsxv3.common.synchronization [req-097f71af-bfd7-4b55-84c0-08b2cc67781f req-31057ba3-969c-4eb2-a005-988eecd0adc2 tempest-ImagesNegativeTestJSON-635333992 tempest-ImagesNegativeTestJSON-635333992-project-member] Enqueued Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_members [ 757.027967] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 with Priority: HIGHEST for action security_group_members [ 757.028081] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.028196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.028262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.028462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.028686] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.028740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.028776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.028897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.028971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.033539] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.097329] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fa01d5d-769a-414f-bcca-45275aa4a90e [ 757.097572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.097721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.097793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.098031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.098129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.098224] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fa01d5d-769a-414f-bcca-45275aa4a90e already deleted. [ 757.098305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fa01d5d-769a-414f-bcca-45275aa4a90e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.541038] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.541038] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.541038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.541038] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 is going to be updated. [ 757.574602] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.574798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.574878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.575106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.575257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.589762] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 in Status: IN_PROGRESS for 2s [ 757.669261] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3efc2ce-5009-447c-a310-4d3178a7395c in Status: SUCCESS [ 757.669607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.732207] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 757.732442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.732665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.732945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.733288] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.733288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.733422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.733496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.733581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.733734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.733771] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.795199] env[69238]: INFO networking_nsxv3.common.synchronization [req-2e291710-54a8-4f86-8172-b6956379b45a req-e553423c-3444-4346-a0e5-d73cfbfdd559 tempest-ServerActionsV293TestJSON-586000412 tempest-ServerActionsV293TestJSON-586000412-project-member] Enqueued Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_members [ 757.795199] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_members [ 757.795875] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.800029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.800029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.800029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.800029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.800029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.800029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.800029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.800029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.800029] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.238656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.238656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.238656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.238656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.238656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.239542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.239542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.239542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.239542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.239542] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.303308] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.303589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.305628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.305628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.305628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.305628] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.305628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.305628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.305992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.305992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.306098] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 already deleted. [ 758.306464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.722687] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b684de33-0c80-4990-9fe3-b60b15dbda4e None None] Enqueued Resource ID: bb57a68d-f557-43d1-b1d6-409722ef7793 with Priority: HIGHEST for action port [ 758.722967] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb57a68d-f557-43d1-b1d6-409722ef7793 with Priority: HIGHEST for action port [ 758.723628] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb57a68d-f557-43d1-b1d6-409722ef7793 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.723714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb57a68d-f557-43d1-b1d6-409722ef7793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.723768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb57a68d-f557-43d1-b1d6-409722ef7793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.724060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb57a68d-f557-43d1-b1d6-409722ef7793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.724663] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb57a68d-f557-43d1-b1d6-409722ef7793',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.742201] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0a6d09e-93ad-4f0a-b077-df666e70f18f: rpc.has_security_group_logging(os_id): False [ 758.760578] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.760907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.761130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.761353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.761460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.761730] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.761823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.761896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.762122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.762529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.762529] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.762826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.762876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.763184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.763302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.763575] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.763703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.763792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.763988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.764113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.764240] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 758.854130] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.854346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.854346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.854605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.854767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.872341] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 759.043169] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.045795] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.045795] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.045795] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.046396] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.046697] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.047503] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.047503] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.047503] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.047781] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.047781] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.047781] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.047995] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.047995] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.048145] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.048258] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.077358] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.078295] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.078295] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.078295] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.078295] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-ff6fb484-fb5d-44cf-904d-8b651b0791a6 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.078295] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.078729] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.078729] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.078836] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff6fb484-fb5d-44cf-904d-8b651b0791a6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.228557] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb57a68d-f557-43d1-b1d6-409722ef7793 [ 759.228557] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.228557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.228557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.228557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.228557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.228557] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb57a68d-f557-43d1-b1d6-409722ef7793 already deleted. [ 759.228557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb57a68d-f557-43d1-b1d6-409722ef7793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.584383] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.584648] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.584840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.585107] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.586157] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.586157] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port ff6fb484-fb5d-44cf-904d-8b651b0791a6 not found, creating... [ 759.586157] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.586157] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.586157] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.586402] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.586484] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.586965] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.587338] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.587460] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.587684] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.587886] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.587949] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: ff6fb484-fb5d-44cf-904d-8b651b0791a6 is going to be created. [ 759.602618] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 in Status: SUCCESS [ 759.602944] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6 deletion is rescheduled due to dependency. [ 759.603026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.614123] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.617642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.617642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.617642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.617642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.617642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.922590] env[69238]: INFO networking_nsxv3.common.synchronization [None req-69da1755-db5a-4ca8-8d18-579b6e6a6387 None None] Enqueued Resource ID: 57575f2b-4e0e-4d64-adcf-b1c0084c90fc with Priority: HIGHEST for action port [ 759.924174] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57575f2b-4e0e-4d64-adcf-b1c0084c90fc with Priority: HIGHEST for action port [ 759.924174] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-57575f2b-4e0e-4d64-adcf-b1c0084c90fc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.924174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57575f2b-4e0e-4d64-adcf-b1c0084c90fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.924174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57575f2b-4e0e-4d64-adcf-b1c0084c90fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.924174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57575f2b-4e0e-4d64-adcf-b1c0084c90fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.924529] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57575f2b-4e0e-4d64-adcf-b1c0084c90fc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.427743] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57575f2b-4e0e-4d64-adcf-b1c0084c90fc [ 760.427974] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.428155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.428211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.428496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.428816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.428816] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57575f2b-4e0e-4d64-adcf-b1c0084c90fc already deleted. [ 760.428816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57575f2b-4e0e-4d64-adcf-b1c0084c90fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.624186] env[69238]: INFO networking_nsxv3.common.synchronization [req-3f1058d1-8563-4ed8-bed5-44d21aa3efdb req-b436eee9-a512-46aa-9ab5-9cbff8e57c59 tempest-DeleteServersAdminTestJSON-638818905 tempest-DeleteServersAdminTestJSON-638818905-project-member] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 760.624814] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 760.625146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.625269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.625685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.625685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.625685] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.626015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.626015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.626015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.626309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.626309] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.888719] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 760.888952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.129184] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.129511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.129511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.130657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.130657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.130657] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.130657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.130657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.130657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.130657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.131061] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be updated. [ 761.165041] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.165041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.165041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.165041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.165041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.178420] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: IN_PROGRESS for 2s [ 761.254268] env[69238]: INFO networking_nsxv3.common.synchronization [None req-4bb849a4-4aa5-41d4-83d0-2c4cc7407e9b None None] Enqueued Resource ID: 2142f882-a1b9-4132-bb8b-1a131116c3b0 with Priority: HIGHEST for action port [ 761.255458] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2142f882-a1b9-4132-bb8b-1a131116c3b0 with Priority: HIGHEST for action port [ 761.255458] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-2142f882-a1b9-4132-bb8b-1a131116c3b0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.255458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2142f882-a1b9-4132-bb8b-1a131116c3b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.255458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2142f882-a1b9-4132-bb8b-1a131116c3b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.256405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2142f882-a1b9-4132-bb8b-1a131116c3b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.256405] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2142f882-a1b9-4132-bb8b-1a131116c3b0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.319438] env[69238]: INFO networking_nsxv3.common.synchronization [req-2e291710-54a8-4f86-8172-b6956379b45a req-845c8885-4af6-480d-be22-e704d513c815 service nova] Enqueued Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_rules [ 761.319878] env[69238]: INFO networking_nsxv3.common.synchronization [req-2e291710-54a8-4f86-8172-b6956379b45a req-845c8885-4af6-480d-be22-e704d513c815 service nova] Enqueued Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_members [ 761.320156] env[69238]: INFO networking_nsxv3.common.synchronization [req-2e291710-54a8-4f86-8172-b6956379b45a req-845c8885-4af6-480d-be22-e704d513c815 service nova] Enqueued Resource ID: ff6fb484-fb5d-44cf-904d-8b651b0791a6 with Priority: HIGHEST for action port [ 761.320689] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_rules [ 761.320847] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_members [ 761.320960] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb484-fb5d-44cf-904d-8b651b0791a6 with Priority: HIGHEST for action port [ 761.321890] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.322104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.322300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.322684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.322786] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.324633] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.324744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.324786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.325954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.326187] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.328672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.328672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.328672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.328672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.328672] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.328672] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff6fb484-fb5d-44cf-904d-8b651b0791a6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.328672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.328672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.328672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.328672] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff6fb484-fb5d-44cf-904d-8b651b0791a6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.472872] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.473229] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.473229] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.473504] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.475349] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.475349] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.475349] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.475349] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.475349] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.475349] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.475612] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.475612] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.475929] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.475929] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.475929] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.476081] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.497931] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.498138] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.498291] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.498514] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.498879] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-601eea29-95d8-4308-bae1-681556f1658a taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.499081] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.499216] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.499630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.499793] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('601eea29-95d8-4308-bae1-681556f1658a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.758889] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2142f882-a1b9-4132-bb8b-1a131116c3b0 [ 761.758889] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.758889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.759281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.759281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.759381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.760082] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2142f882-a1b9-4132-bb8b-1a131116c3b0 already deleted. [ 761.760082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2142f882-a1b9-4132-bb8b-1a131116c3b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.831735] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.831735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.831735] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.832505] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff6fb484-fb5d-44cf-904d-8b651b0791a6 with status ACTIVE [ 761.833015] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.833321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.833693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.836100] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.836100] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.836100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.836100] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff6fb484-fb5d-44cf-904d-8b651b0791a6 is going to be updated. [ 761.865074] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.865325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.865325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.865467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.865631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.865811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff6fb484-fb5d-44cf-904d-8b651b0791a6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.003543] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.003543] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.003543] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.003543] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.003543] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.003543] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 601eea29-95d8-4308-bae1-681556f1658a not found, creating... [ 762.004155] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.004155] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.004301] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.004617] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.004930] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.005754] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.005891] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.006033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.006297] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.006485] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.006737] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 601eea29-95d8-4308-bae1-681556f1658a is going to be created. [ 762.037022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.037022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.037022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.037022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.037022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.037022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.334075] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.837180] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.837357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.837612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.837724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.837827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.837930] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 is going to be created. [ 762.865613] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.865613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.865613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.865613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.865613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.875681] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01854ee2-08ca-46e9-8724-734e384f01a4 in Status: UNINITIALIZED for 2s [ 763.143648] env[69238]: INFO networking_nsxv3.common.synchronization [req-3f1058d1-8563-4ed8-bed5-44d21aa3efdb req-a88a0981-f370-47a3-b1dc-1bbbbaee3e59 service nova] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_rules [ 763.143826] env[69238]: INFO networking_nsxv3.common.synchronization [req-3f1058d1-8563-4ed8-bed5-44d21aa3efdb req-a88a0981-f370-47a3-b1dc-1bbbbaee3e59 service nova] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 763.143956] env[69238]: INFO networking_nsxv3.common.synchronization [req-3f1058d1-8563-4ed8-bed5-44d21aa3efdb req-a88a0981-f370-47a3-b1dc-1bbbbaee3e59 service nova] Enqueued Resource ID: 601eea29-95d8-4308-bae1-681556f1658a with Priority: HIGHEST for action port [ 763.144228] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_rules [ 763.144360] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 763.144455] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 601eea29-95d8-4308-bae1-681556f1658a with Priority: HIGHEST for action port [ 763.146093] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.146251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.146315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.146513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.146595] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.147824] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.147971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.148182] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-601eea29-95d8-4308-bae1-681556f1658a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.148289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.150143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.150143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.150143] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('601eea29-95d8-4308-bae1-681556f1658a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.200409] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: SUCCESS [ 763.200734] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 deletion is rescheduled due to dependency. [ 763.200877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.201551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.201778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.201972] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.202107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.202393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.203515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.203724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.203817] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.652171] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.652171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.653287] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 601eea29-95d8-4308-bae1-681556f1658a with status ACTIVE [ 763.653287] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.653287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.653764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.654047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.654177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.655349] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.655447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.655489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.655813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.655813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.656016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.656121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.656165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.656319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.656396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.656496] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 601eea29-95d8-4308-bae1-681556f1658a is going to be updated. [ 763.677905] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.678059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.678125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.678327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.678456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.678613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-601eea29-95d8-4308-bae1-681556f1658a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.706168] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.211194] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.714832] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.715203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.715203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.715377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.715470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.715593] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be updated. [ 764.751086] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.751274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.751324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.751542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.751699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.763141] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: IN_PROGRESS for 2s [ 765.090175] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01854ee2-08ca-46e9-8724-734e384f01a4 in Status: SUCCESS [ 765.090175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.090175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.090726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.090880] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.090980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.091040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.091281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.091425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.091574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.091716] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.598429] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.617654] env[69238]: INFO networking_nsxv3.common.synchronization [req-f4c81c6f-ef48-4ba5-ad6d-0cf98996ff45 req-3942f7e4-1e54-4e38-8780-c23d0064dbcf tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 765.618295] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 765.618714] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.618986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.618986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.625032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.625032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.625032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.625032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.625303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.625303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.625303] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.991448] env[69238]: INFO networking_nsxv3.common.synchronization [None req-fb91c3af-39fb-4c0c-97be-e2585d2e513d None None] Enqueued Resource ID: 455c15c4-c1b1-4873-ba4c-300210bfb1fc with Priority: HIGHEST for action port [ 765.991448] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 455c15c4-c1b1-4873-ba4c-300210bfb1fc with Priority: HIGHEST for action port [ 765.991448] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-455c15c4-c1b1-4873-ba4c-300210bfb1fc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.991448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-455c15c4-c1b1-4873-ba4c-300210bfb1fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.991448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-455c15c4-c1b1-4873-ba4c-300210bfb1fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.991448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-455c15c4-c1b1-4873-ba4c-300210bfb1fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.991448] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('455c15c4-c1b1-4873-ba4c-300210bfb1fc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.103451] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01854ee2-08ca-46e9-8724-734e384f01a4: rpc.has_security_group_logging(os_id): False [ 766.125717] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.125881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.125948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.126225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.126315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.126587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.126684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.126782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.129130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.129130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.129130] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 is going to be created. [ 766.129130] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.129130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.130691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.130962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.131225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.131481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.131615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.131679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.131839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.131966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.132092] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 already deleted. [ 766.132210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.204457] env[69238]: INFO networking_nsxv3.common.synchronization [None req-062d2978-0211-4a6b-b632-5a757b5b1cda None None] Enqueued Resource ID: d3bcd7e3-5698-402c-b92e-1a1c356ca1f1 with Priority: HIGHEST for action port [ 766.206685] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.206852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.207447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.207843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.208079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.210475] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3bcd7e3-5698-402c-b92e-1a1c356ca1f1 with Priority: HIGHEST for action port [ 766.211254] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3bcd7e3-5698-402c-b92e-1a1c356ca1f1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.211427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3bcd7e3-5698-402c-b92e-1a1c356ca1f1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.211554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3bcd7e3-5698-402c-b92e-1a1c356ca1f1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.211848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3bcd7e3-5698-402c-b92e-1a1c356ca1f1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.211946] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3bcd7e3-5698-402c-b92e-1a1c356ca1f1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.226182] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01854ee2-08ca-46e9-8724-734e384f01a4 in Status: IN_PROGRESS for 2s [ 766.493791] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 455c15c4-c1b1-4873-ba4c-300210bfb1fc [ 766.494781] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.494781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.494781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.494781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.494781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.496225] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:455c15c4-c1b1-4873-ba4c-300210bfb1fc already deleted. [ 766.496225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-455c15c4-c1b1-4873-ba4c-300210bfb1fc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.714287] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3bcd7e3-5698-402c-b92e-1a1c356ca1f1 [ 766.717601] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.717601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.717601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.717601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.717601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.717601] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3bcd7e3-5698-402c-b92e-1a1c356ca1f1 already deleted. [ 766.717601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3bcd7e3-5698-402c-b92e-1a1c356ca1f1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.773621] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: SUCCESS [ 766.774847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.774847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.774847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.774847] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.774847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.774847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.775258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.775258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.775258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.775258] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.926277] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.926482] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.926782] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.926989] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.927289] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.928189] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.928189] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.928189] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.928189] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.928189] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.928744] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.928744] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.928744] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.928744] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.928744] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.928912] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.955097] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.958540] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 766.961473] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.961473] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.961473] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.961473] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.961473] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.961473] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.961473] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f231a88-0dca-4ef1-a08b-f7b7a603c0b9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.278011] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.278379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.278379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.280029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.280029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.280029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.280029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.280029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.280029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.280029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.280029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.280537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.280816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.281011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.281967] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.282089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.282156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.283335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.283335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.283335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.283335] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.466855] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.466855] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.466855] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.467327] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.468227] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.468486] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 not found, creating... [ 767.468779] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.469312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.469312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.469457] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.469595] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.469938] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.470123] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.471898] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.471898] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.471898] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.471898] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 is going to be created. [ 767.496817] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.496977] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.498317] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.499124] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.499487] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.500316] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.786178] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7: rpc.has_security_group_logging(os_id): False [ 767.806434] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.806688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.806688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.807051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.807153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.807643] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.807643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.807643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.807824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.807824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.808111] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.808111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.808291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.808291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.808542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.808542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.808778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.809396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.809396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.809591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.809676] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be updated. [ 767.878350] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.878506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.878579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.878793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.878937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.905368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: IN_PROGRESS for 2s [ 768.246519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01854ee2-08ca-46e9-8724-734e384f01a4 in Status: SUCCESS [ 768.246519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.764798] env[69238]: INFO networking_nsxv3.common.synchronization [None req-62b2e31e-9bd0-45b5-8918-0bbe387f9573 None None] Enqueued Resource ID: 0fe47bc0-de8a-41b5-b643-3639745c9957 with Priority: HIGHEST for action port [ 768.765505] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe47bc0-de8a-41b5-b643-3639745c9957 with Priority: HIGHEST for action port [ 768.765948] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe47bc0-de8a-41b5-b643-3639745c9957 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.770352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe47bc0-de8a-41b5-b643-3639745c9957" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.770352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe47bc0-de8a-41b5-b643-3639745c9957" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.770352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe47bc0-de8a-41b5-b643-3639745c9957" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.770352] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe47bc0-de8a-41b5-b643-3639745c9957',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.783578] env[69238]: INFO networking_nsxv3.common.synchronization [None req-390f5bc8-64a0-4421-a3da-5e72fb4e88e2 None None] Enqueued Resource ID: 296e0411-482e-4a0f-bbb9-2c5680a07d75 with Priority: HIGHEST for action port [ 768.783798] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296e0411-482e-4a0f-bbb9-2c5680a07d75 with Priority: HIGHEST for action port [ 768.784328] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-296e0411-482e-4a0f-bbb9-2c5680a07d75 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.784445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-296e0411-482e-4a0f-bbb9-2c5680a07d75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.784510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-296e0411-482e-4a0f-bbb9-2c5680a07d75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.784791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-296e0411-482e-4a0f-bbb9-2c5680a07d75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.784869] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('296e0411-482e-4a0f-bbb9-2c5680a07d75',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.820554] env[69238]: INFO networking_nsxv3.common.synchronization [req-f4c81c6f-ef48-4ba5-ad6d-0cf98996ff45 req-3aa51403-3135-4c3f-b301-c81a7fa3aadd service nova] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 768.820733] env[69238]: INFO networking_nsxv3.common.synchronization [req-f4c81c6f-ef48-4ba5-ad6d-0cf98996ff45 req-3aa51403-3135-4c3f-b301-c81a7fa3aadd service nova] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 768.820873] env[69238]: INFO networking_nsxv3.common.synchronization [req-f4c81c6f-ef48-4ba5-ad6d-0cf98996ff45 req-3aa51403-3135-4c3f-b301-c81a7fa3aadd service nova] Enqueued Resource ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with Priority: HIGHEST for action port [ 768.821383] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 768.821524] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 768.821635] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with Priority: HIGHEST for action port [ 768.823637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.823772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.823824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.824055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.824143] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.825742] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.825742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.825742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.825742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.826168] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.826168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.826168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.826168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.826451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.827548] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.828419] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.828537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.828609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.828761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.828887] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f231a88-0dca-4ef1-a08b-f7b7a603c0b9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.271926] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fe47bc0-de8a-41b5-b643-3639745c9957 [ 769.272225] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.272400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.272491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.272752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.272876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.273015] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fe47bc0-de8a-41b5-b643-3639745c9957 already deleted. [ 769.273128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe47bc0-de8a-41b5-b643-3639745c9957" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.287044] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 296e0411-482e-4a0f-bbb9-2c5680a07d75 [ 769.287198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.287332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.287436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.287644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.287789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.287902] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:296e0411-482e-4a0f-bbb9-2c5680a07d75 already deleted. [ 769.289309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-296e0411-482e-4a0f-bbb9-2c5680a07d75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.333146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.333146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.333146] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.333146] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with status ACTIVE [ 769.333146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.333146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.333146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.333146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.333146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.333146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.333146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.333146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.333892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.335899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.335899] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.335899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.335899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.335899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.335899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.335899] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 is going to be updated. [ 769.358917] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.359945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.359945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.359945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.359945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.359945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.614163] env[69238]: INFO networking_nsxv3.common.synchronization [None req-dd68955d-39c9-43b5-b953-7b4a37f560df tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_rules [ 769.614799] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_rules [ 769.615170] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.615559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.615559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.615677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.615782] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.799300] env[69238]: INFO networking_nsxv3.common.synchronization [None req-a7d27b7c-48ec-434a-8a93-5090f19b6a61 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_rules [ 769.800019] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_rules [ 769.800413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.800413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.838631] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.927175] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: SUCCESS [ 769.927320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.139415] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.139563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.139637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.139851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.139941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.140046] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c already deleted. [ 770.140132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.140566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.140735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.140836] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.341983] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.342297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.342297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.342489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.342489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.342613] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be created. [ 770.386941] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.387181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.387227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.387415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.387623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.401995] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: UNINITIALIZED for 2s [ 770.668222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.668383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.668529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.668682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.668792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.668956] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c already deleted. [ 770.669033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.961336] env[69238]: INFO networking_nsxv3.common.synchronization [req-8218a0ee-87fb-48a7-8ccc-5f1b50466855 req-eb3fbc45-a927-404c-a2a5-0954267c0adf tempest-MigrationsAdminTest-400782288 tempest-MigrationsAdminTest-400782288-project-member] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 770.961336] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 770.961336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.961336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.961336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.962015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.962493] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.963230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.963230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.963230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.963230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.963400] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.391628] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.394151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.394151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.394151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.394151] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.394151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.394151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.394151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.394151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.394151] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.394514] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.394514] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.394646] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.394806] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.394999] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.396343] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.425372] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.425556] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.425672] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.425880] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.426264] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-7e98c34d-2979-47d1-9581-98c08d2615cd taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.426466] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.426923] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.426961] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.427113] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e98c34d-2979-47d1-9581-98c08d2615cd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.466460] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.466978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.467529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.467784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.468050] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.468131] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.468254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.468345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.468871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.468871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.468871] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c already deleted. [ 771.468871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.929576] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.929847] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.929934] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.930641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.930904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.931222] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 7e98c34d-2979-47d1-9581-98c08d2615cd not found, creating... [ 771.932232] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.932232] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.932232] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.935388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.935388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.935388] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.935388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.935388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.935388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.935388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.935388] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 7e98c34d-2979-47d1-9581-98c08d2615cd is going to be created. [ 771.973328] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.973328] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.973328] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.973838] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.973838] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.974202] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.413972] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 772.413972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.414183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.414436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.414739] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.414893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.414968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.415161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.415250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.415340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.415664] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.920870] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.105209] env[69238]: INFO networking_nsxv3.common.synchronization [req-8218a0ee-87fb-48a7-8ccc-5f1b50466855 req-cc44a03d-5faf-4bd6-8e08-d2a832067499 service nova] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_rules [ 773.105209] env[69238]: INFO networking_nsxv3.common.synchronization [req-8218a0ee-87fb-48a7-8ccc-5f1b50466855 req-cc44a03d-5faf-4bd6-8e08-d2a832067499 service nova] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 773.105209] env[69238]: INFO networking_nsxv3.common.synchronization [req-8218a0ee-87fb-48a7-8ccc-5f1b50466855 req-cc44a03d-5faf-4bd6-8e08-d2a832067499 service nova] Enqueued Resource ID: 7e98c34d-2979-47d1-9581-98c08d2615cd with Priority: HIGHEST for action port [ 773.105209] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_rules [ 773.105209] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 773.105209] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e98c34d-2979-47d1-9581-98c08d2615cd with Priority: HIGHEST for action port [ 773.105209] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.105209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.105209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.105209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.110008] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.110008] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.110008] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.110008] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.110008] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e98c34d-2979-47d1-9581-98c08d2615cd taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.110008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.115223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.115550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.116202] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e98c34d-2979-47d1-9581-98c08d2615cd',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.267351] env[69238]: INFO networking_nsxv3.common.synchronization [req-e1617c3f-c5bc-480a-8234-a611b9c2430a req-60ff953d-79f4-4c2a-b476-42832bda3ce8 tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 773.267351] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 773.267351] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.267351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.267351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.267622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.267622] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.267686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.267761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.267866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.267957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.268070] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.421933] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af5e1a5e-9272-4c94-94cf-f661ba1cc217: rpc.has_security_group_logging(os_id): False [ 773.441061] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.441275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.441327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.441622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.441700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.441902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.442000] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.442076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.442256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.442348] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.442437] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be created. [ 773.515420] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.515623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.515738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.516123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.516432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.529400] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 773.619088] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.619247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.619427] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.621108] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e98c34d-2979-47d1-9581-98c08d2615cd with status ACTIVE [ 773.621354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.621745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.621745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.621889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.621889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.622852] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.622852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.622852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.622852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.622852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.623268] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.623268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.623413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.623596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.623711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.623811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e98c34d-2979-47d1-9581-98c08d2615cd is going to be updated. [ 773.674668] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.674990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.674990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.675226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.675363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.675537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e98c34d-2979-47d1-9581-98c08d2615cd" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.772187] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.772187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.772187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.772187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.772187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.772187] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.772187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.772187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.772187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.772756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.772756] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 773.814190] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.814401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.814457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.814680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.814828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.829989] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 774.126776] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.304285] env[69238]: INFO networking_nsxv3.common.synchronization [None req-66d633de-adec-4907-8069-b67941d3d033 None None] Enqueued Resource ID: 0e902f2d-7932-4ca7-a254-a41272b15982 with Priority: HIGHEST for action port [ 774.304285] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e902f2d-7932-4ca7-a254-a41272b15982 with Priority: HIGHEST for action port [ 774.306123] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e902f2d-7932-4ca7-a254-a41272b15982 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.306421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e902f2d-7932-4ca7-a254-a41272b15982" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.306870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e902f2d-7932-4ca7-a254-a41272b15982" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.308555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e902f2d-7932-4ca7-a254-a41272b15982" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.308555] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e902f2d-7932-4ca7-a254-a41272b15982',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.628576] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.628743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.628813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.629091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.629183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.629283] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be created. [ 774.656797] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.656984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.657108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.657390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.657559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.669371] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: UNINITIALIZED for 2s [ 774.810631] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e902f2d-7932-4ca7-a254-a41272b15982 [ 774.810963] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.811099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.811173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.811501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.811654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.811804] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e902f2d-7932-4ca7-a254-a41272b15982 already deleted. [ 774.811944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e902f2d-7932-4ca7-a254-a41272b15982" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.548304] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 775.548639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.842748] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 775.843014] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 deletion is rescheduled due to dependency. [ 775.843334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.601413] env[69238]: INFO networking_nsxv3.common.synchronization [req-9d89039f-18a8-4745-8dd7-7a676ba28994 req-c1a00517-49f8-4486-96be-61b2b1c9eb79 tempest-ServersV294TestFqdnHostnames-1544691138 tempest-ServersV294TestFqdnHostnames-1544691138-project-member] Enqueued Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_members [ 776.601710] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_members [ 776.602142] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.602422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.602422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.602907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.605091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.609251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.609251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.609251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.609251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.609251] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.683722] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 776.684042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.684240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.684589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.684931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.685175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.685281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.685460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.685559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.685646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.685815] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.111433] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.111692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.111692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.111915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.112031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.112246] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.112349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.112414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.112580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.112665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.112760] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d84f347-c5bd-4943-8736-772c25927665 already deleted. [ 777.112848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.188731] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.188731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.188731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.188731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.188731] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.188964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.188964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.189786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.189786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.189786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.189786] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.189786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.189786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.189786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.189786] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.190111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.190111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.190111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.190111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.190213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.190263] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.252136] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-417 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.252408] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-417" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.253391] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-417" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.253780] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-417" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.254275] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.254647] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.254647] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.254818] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.254991] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.255228] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.255347] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.255457] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.255853] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.255912] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.256049] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.256201] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.319137] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.319137] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.060 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.319137] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.319137] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-417" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.319137] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-10fa0cef-af18-4ac6-b792-947b9e3f7e40 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.319137] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.319137] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.319137] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.319137] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10fa0cef-af18-4ac6-b792-947b9e3f7e40',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.365369] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b47902e1-fb4a-44d3-b0fc-7b74cd8fc155 None None] Enqueued Resource ID: dc55f9e2-1c96-4475-80d4-9f738f2c3844 with Priority: HIGHEST for action port [ 777.365369] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc55f9e2-1c96-4475-80d4-9f738f2c3844 with Priority: HIGHEST for action port [ 777.365947] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc55f9e2-1c96-4475-80d4-9f738f2c3844 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.366101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc55f9e2-1c96-4475-80d4-9f738f2c3844" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.366170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc55f9e2-1c96-4475-80d4-9f738f2c3844" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.366427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc55f9e2-1c96-4475-80d4-9f738f2c3844" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.366539] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc55f9e2-1c96-4475-80d4-9f738f2c3844',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.694647] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9289966e-1f55-477f-8d5c-d3d5fe95527c: rpc.has_security_group_logging(os_id): False [ 777.718217] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.718419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.718507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.718690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.718802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.719042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.719191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.719268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.719404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.719484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.719666] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.719780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.719832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.719995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.721218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.721480] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.721610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.721675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.721827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.721932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.722041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be created. [ 777.789016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.790222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.790314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.790547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.790792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.810425] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: IN_PROGRESS for 2s [ 777.825258] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.825258] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.825258] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.825258] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.825662] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.825662] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 10fa0cef-af18-4ac6-b792-947b9e3f7e40 not found, creating... [ 777.826334] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.826334] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.826334] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.827336] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.827336] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.827336] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.827611] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.830023] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.830023] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.830023] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.830023] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 10fa0cef-af18-4ac6-b792-947b9e3f7e40 is going to be created. [ 777.852299] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.852872] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.852872] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.853162] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.853426] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.853694] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.868882] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc55f9e2-1c96-4475-80d4-9f738f2c3844 [ 777.869139] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.869298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.869367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.869767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.869875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.869980] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc55f9e2-1c96-4475-80d4-9f738f2c3844 already deleted. [ 777.870072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc55f9e2-1c96-4475-80d4-9f738f2c3844" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.924235] env[69238]: INFO networking_nsxv3.common.synchronization [req-0e08e400-e1a0-45ab-9d7a-248bbbad6089 req-28f433a5-f473-490f-ac56-f08024f59190 tempest-DeleteServersAdminTestJSON-638818905 tempest-DeleteServersAdminTestJSON-638818905-project-member] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 777.925977] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGHEST for action security_group_members [ 777.926416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.926558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.926629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.926843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.927483] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.927483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.927483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.927483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.927701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.927701] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.430467] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.430587] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.430631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.430882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.431025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.431220] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.431342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.431405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.431573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.431678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.431734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be updated. [ 778.467245] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.467461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.467555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.467811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.467986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.479339] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: IN_PROGRESS for 2s [ 778.749624] env[69238]: INFO networking_nsxv3.common.synchronization [req-9d89039f-18a8-4745-8dd7-7a676ba28994 req-e94e9cab-9648-460e-9086-72ca5e571eef service nova] Enqueued Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_rules [ 778.749913] env[69238]: INFO networking_nsxv3.common.synchronization [req-9d89039f-18a8-4745-8dd7-7a676ba28994 req-e94e9cab-9648-460e-9086-72ca5e571eef service nova] Enqueued Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_members [ 778.749913] env[69238]: INFO networking_nsxv3.common.synchronization [req-9d89039f-18a8-4745-8dd7-7a676ba28994 req-e94e9cab-9648-460e-9086-72ca5e571eef service nova] Enqueued Resource ID: 10fa0cef-af18-4ac6-b792-947b9e3f7e40 with Priority: HIGHEST for action port [ 778.750250] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_rules [ 778.754025] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_members [ 778.754025] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10fa0cef-af18-4ac6-b792-947b9e3f7e40 with Priority: HIGHEST for action port [ 778.754585] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.755098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.755098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.755098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.755292] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.760645] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.761051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.761051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.761133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.761242] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.761340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.761449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.761557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.761641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.761781] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.764100] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-10fa0cef-af18-4ac6-b792-947b9e3f7e40 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.764240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.764280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.764461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.764578] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10fa0cef-af18-4ac6-b792-947b9e3f7e40',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.261673] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.261673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.268025] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.268025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10fa0cef-af18-4ac6-b792-947b9e3f7e40 with status ACTIVE [ 779.268025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.268025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.268025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.268025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.268025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.268025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.268025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.268025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.268025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.268947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.268947] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.269176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.269176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.271047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.271047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.271047] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10fa0cef-af18-4ac6-b792-947b9e3f7e40 is going to be updated. [ 779.305321] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.305321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.305321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.305321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.305634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.305634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10fa0cef-af18-4ac6-b792-947b9e3f7e40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.545747] env[69238]: INFO networking_nsxv3.common.synchronization [req-df57014f-31fe-4ad9-9249-5ac6ce2fbb92 req-21d548ca-5178-4fd8-af1a-3b923b02c846 tempest-TenantUsagesTestJSON-1548457129 tempest-TenantUsagesTestJSON-1548457129-project-member] Enqueued Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_members [ 779.548990] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_members [ 779.548990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.548990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.548990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.548990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.548990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.548990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.548990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.548990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.548990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.548990] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.774756] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.826998] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 779.826998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.868137] env[69238]: INFO networking_nsxv3.common.synchronization [None req-231e12dd-7dfa-4a2b-ace5-d827304136de None None] Enqueued Resource ID: 440b3ae7-3ed4-4ec7-8b93-19e1fa328784 with Priority: HIGHEST for action port [ 779.868137] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440b3ae7-3ed4-4ec7-8b93-19e1fa328784 with Priority: HIGHEST for action port [ 779.868366] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-440b3ae7-3ed4-4ec7-8b93-19e1fa328784 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.868483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-440b3ae7-3ed4-4ec7-8b93-19e1fa328784" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.868547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-440b3ae7-3ed4-4ec7-8b93-19e1fa328784" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.868791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-440b3ae7-3ed4-4ec7-8b93-19e1fa328784" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.868867] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('440b3ae7-3ed4-4ec7-8b93-19e1fa328784',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.051403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.053173] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.053173] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 already deleted. [ 780.053173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.278515] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.278684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.278740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.278948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.279052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.279153] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d84f347-c5bd-4943-8736-772c25927665 is going to be created. [ 780.312132] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.312132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.312132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.312132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.312132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.327875] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d84f347-c5bd-4943-8736-772c25927665 in Status: UNINITIALIZED for 2s [ 780.359956] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.360342] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.360342] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.360707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.360858] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.362694] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.363060] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.363286] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.363451] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.363688] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.363782] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.363891] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.363998] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.364121] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.364226] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.364368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.373853] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 440b3ae7-3ed4-4ec7-8b93-19e1fa328784 [ 780.373969] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.374074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.374148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.374729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.374729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.374729] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:440b3ae7-3ed4-4ec7-8b93-19e1fa328784 already deleted. [ 780.374729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-440b3ae7-3ed4-4ec7-8b93-19e1fa328784" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.391957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.392161] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.392305] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.392482] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.392798] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.392977] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.393090] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.393426] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.393595] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e461d9e-38ad-4c5a-8744-9a36d094c0bf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.492964] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 in Status: SUCCESS [ 780.492964] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 deletion is rescheduled due to dependency. [ 780.493344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.872080] env[69238]: INFO networking_nsxv3.common.synchronization [req-fe9b112e-6e33-4697-a2c6-7db17f5d07b2 req-31b1dc71-a23a-4801-849b-00947b66ffea tempest-ServersAdminNegativeTestJSON-838199429 tempest-ServersAdminNegativeTestJSON-838199429-project-member] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 780.872770] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 780.873719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.873878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.873952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.874444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.874661] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.874789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.874884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.875127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.875271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.875407] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.899189] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.899538] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.899776] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.900372] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.901488] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.901488] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 8e461d9e-38ad-4c5a-8744-9a36d094c0bf not found, creating... [ 780.901488] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.901652] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.901821] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.902154] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.902346] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.902687] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.902902] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.903100] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.903373] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.903610] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.903799] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 8e461d9e-38ad-4c5a-8744-9a36d094c0bf is going to be created. [ 780.930917] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.931110] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.931295] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.931670] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.931916] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.932285] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.380041] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.883022] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.106808] env[69238]: INFO networking_nsxv3.common.synchronization [req-df57014f-31fe-4ad9-9249-5ac6ce2fbb92 req-20f14402-5cc6-44e6-a69a-b5e17cff3858 service nova] Enqueued Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_rules [ 782.107023] env[69238]: INFO networking_nsxv3.common.synchronization [req-df57014f-31fe-4ad9-9249-5ac6ce2fbb92 req-20f14402-5cc6-44e6-a69a-b5e17cff3858 service nova] Enqueued Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_members [ 782.107167] env[69238]: INFO networking_nsxv3.common.synchronization [req-df57014f-31fe-4ad9-9249-5ac6ce2fbb92 req-20f14402-5cc6-44e6-a69a-b5e17cff3858 service nova] Enqueued Resource ID: 8e461d9e-38ad-4c5a-8744-9a36d094c0bf with Priority: HIGHEST for action port [ 782.107443] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_rules [ 782.107583] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_members [ 782.107676] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e461d9e-38ad-4c5a-8744-9a36d094c0bf with Priority: HIGHEST for action port [ 782.108950] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.109363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.109474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.110029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.110193] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.111495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.112240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.112345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.112556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.112738] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.112845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.112947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.113638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.113769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.113908] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.118046] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.118046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.118046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.118046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.118046] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e461d9e-38ad-4c5a-8744-9a36d094c0bf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.340554] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d84f347-c5bd-4943-8736-772c25927665 in Status: SUCCESS [ 782.340554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.340554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.340554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.340866] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.340866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.340949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.341958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.341958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.341958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.341958] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.386223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.386352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.386352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.386569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.386657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.386762] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be updated. [ 782.421349] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.421485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.421524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.421736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.421884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.433701] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: IN_PROGRESS for 2s [ 782.453400] env[69238]: INFO networking_nsxv3.common.synchronization [None req-ea3d974d-a16d-4776-a34d-24e120604c1e None None] Enqueued Resource ID: bce75438-c609-482a-aaef-6ed3a311d180 with Priority: HIGHEST for action port [ 782.453664] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce75438-c609-482a-aaef-6ed3a311d180 with Priority: HIGHEST for action port [ 782.454250] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bce75438-c609-482a-aaef-6ed3a311d180 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.454382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bce75438-c609-482a-aaef-6ed3a311d180" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.454442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bce75438-c609-482a-aaef-6ed3a311d180" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.454767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bce75438-c609-482a-aaef-6ed3a311d180" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.454767] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce75438-c609-482a-aaef-6ed3a311d180',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.618355] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.618355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.623026] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.623026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e461d9e-38ad-4c5a-8744-9a36d094c0bf with status ACTIVE [ 782.623026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.623026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.623026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.623026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.623904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.623904] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e461d9e-38ad-4c5a-8744-9a36d094c0bf is going to be updated. [ 782.650828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.651951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.651951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.653145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.653145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.653145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e461d9e-38ad-4c5a-8744-9a36d094c0bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.846042] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.969340] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bce75438-c609-482a-aaef-6ed3a311d180 [ 782.969340] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.969340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.969340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.969340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.969340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.969340] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bce75438-c609-482a-aaef-6ed3a311d180 already deleted. [ 782.969340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bce75438-c609-482a-aaef-6ed3a311d180" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.127145] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.348824] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d84f347-c5bd-4943-8736-772c25927665: rpc.has_security_group_logging(os_id): False [ 783.367823] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.367907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.367936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.371022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.371022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.371022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.371022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.371022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.371022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.371022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.371022] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d84f347-c5bd-4943-8736-772c25927665 is going to be created. [ 783.431849] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.432073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.432150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.432394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.432542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.444802] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d84f347-c5bd-4943-8736-772c25927665 in Status: IN_PROGRESS for 2s [ 783.630085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.630085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.630256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.630495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.630591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.630700] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 is going to be created. [ 783.661704] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.661704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.661704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.661891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.662071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.675218] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 in Status: UNINITIALIZED for 2s [ 784.449350] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: SUCCESS [ 784.449636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.458957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d84f347-c5bd-4943-8736-772c25927665 in Status: SUCCESS [ 785.459319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.688909] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 in Status: SUCCESS [ 785.689162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.689340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.690241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.690241] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.690241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.690241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.690241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.690241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.690241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.690532] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.017034] env[69238]: INFO networking_nsxv3.common.synchronization [None req-455db0e9-b76e-4bdf-ba85-3716f330f7ba None None] Enqueued Resource ID: 0058a3af-1802-438a-9ddc-569735674d02 with Priority: HIGHEST for action port [ 786.017642] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0058a3af-1802-438a-9ddc-569735674d02 with Priority: HIGHEST for action port [ 786.017642] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0058a3af-1802-438a-9ddc-569735674d02 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.017753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0058a3af-1802-438a-9ddc-569735674d02" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.017753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0058a3af-1802-438a-9ddc-569735674d02" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.022417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0058a3af-1802-438a-9ddc-569735674d02" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.022417] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0058a3af-1802-438a-9ddc-569735674d02',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.197862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.197862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.197862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.197862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.197862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.199258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.199258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.199258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.199258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.199258] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.523760] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0058a3af-1802-438a-9ddc-569735674d02 [ 786.524213] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.524318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.524366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.524555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.524637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.524748] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0058a3af-1802-438a-9ddc-569735674d02 already deleted. [ 786.524876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0058a3af-1802-438a-9ddc-569735674d02" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.700753] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e0ac3f6-a8a3-4493-abbd-ec93cceade61: rpc.has_security_group_logging(os_id): False [ 786.724122] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.724264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.724334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.724578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.724642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.724861] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.724979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.725041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.725203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.725281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.725492] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.725591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.725654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.725772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.725844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.726062] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.726301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.726301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.726429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.726462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.726527] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 is going to be created. [ 786.798029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.798029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.798029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.798029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.798029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.809839] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 in Status: IN_PROGRESS for 2s [ 788.825378] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 in Status: SUCCESS [ 788.825378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.989498] env[69238]: INFO networking_nsxv3.common.synchronization [None req-3d9c52f8-e13e-4b44-a164-b4428a29f67e None None] Enqueued Resource ID: 9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1 with Priority: HIGHEST for action port [ 788.989868] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1 with Priority: HIGHEST for action port [ 788.990553] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.990719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.990794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.991331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.991793] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.387293] env[69238]: INFO networking_nsxv3.common.synchronization [None req-6f01ce7b-ec44-4bdc-b779-2e8aa7fd1ecf None None] Enqueued Resource ID: bed057ce-af7d-479c-b11d-437bbcc0bf6e with Priority: HIGHEST for action port [ 789.387683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed057ce-af7d-479c-b11d-437bbcc0bf6e with Priority: HIGHEST for action port [ 789.388250] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bed057ce-af7d-479c-b11d-437bbcc0bf6e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.388325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bed057ce-af7d-479c-b11d-437bbcc0bf6e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.388372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bed057ce-af7d-479c-b11d-437bbcc0bf6e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.388607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bed057ce-af7d-479c-b11d-437bbcc0bf6e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.388687] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed057ce-af7d-479c-b11d-437bbcc0bf6e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.494572] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1 [ 789.495638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.495638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.495638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.495638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.495638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.495638] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1 already deleted. [ 789.495638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e5ac7dd-5e79-437f-9de6-cf4ec0d39fb1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.833733] env[69238]: INFO networking_nsxv3.common.synchronization [req-666d82a6-fe67-4843-92ed-37e462b32b7a req-b8ccd950-2402-4b59-a86c-58733e3ab705 tempest-FloatingIPsAssociationTestJSON-1554317950 tempest-FloatingIPsAssociationTestJSON-1554317950-project-member] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 789.836650] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 789.836650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.836650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.836650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.836650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.836650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.836650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.836650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.836650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.836650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.836650] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.892780] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bed057ce-af7d-479c-b11d-437bbcc0bf6e [ 789.893880] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.893880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.893880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.893880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.893880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.893880] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bed057ce-af7d-479c-b11d-437bbcc0bf6e already deleted. [ 789.894940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bed057ce-af7d-479c-b11d-437bbcc0bf6e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.339464] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.800956] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-862 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.801608] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.801971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.802571] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.803227] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.803767] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.804127] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.804534] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.804973] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.805344] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.805694] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.805913] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.806216] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.806473] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.806747] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.808353] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.829728] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.829728] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.830398] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.830398] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-862" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.831038] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-dafa1dde-bbda-48ab-962b-c86044ca41c6 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.831193] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.831320] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.831648] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.832570] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafa1dde-bbda-48ab-962b-c86044ca41c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.842119] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.335263] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.335525] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.335649] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.336225] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.336437] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.336717] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port dafa1dde-bbda-48ab-962b-c86044ca41c6 not found, creating... [ 791.337393] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.337393] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.337393] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.337559] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.337559] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.338836] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.338836] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.338836] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.339069] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.339069] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.339128] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: dafa1dde-bbda-48ab-962b-c86044ca41c6 is going to be created. [ 791.345294] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.347152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.347242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.347393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.347503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.347590] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc is going to be updated. [ 791.365477] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.365646] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.365812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.366156] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.366434] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.366738] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.384597] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.384789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.384867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.385878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.385878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.396389] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: IN_PROGRESS for 2s [ 791.490124] env[69238]: INFO networking_nsxv3.common.synchronization [None req-1e82aa5a-3c8f-40cd-a5a9-169300e5f3b2 None None] Enqueued Resource ID: bd54b12e-0bab-45ae-a778-97e3e57f18be with Priority: HIGHEST for action port [ 791.490124] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd54b12e-0bab-45ae-a778-97e3e57f18be with Priority: HIGHEST for action port [ 791.492170] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd54b12e-0bab-45ae-a778-97e3e57f18be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.493792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd54b12e-0bab-45ae-a778-97e3e57f18be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.493792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd54b12e-0bab-45ae-a778-97e3e57f18be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.493943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd54b12e-0bab-45ae-a778-97e3e57f18be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.495069] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd54b12e-0bab-45ae-a778-97e3e57f18be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.733255] env[69238]: INFO networking_nsxv3.common.synchronization [None req-504943fc-fd9b-4d21-9309-def5941d529f tempest-VolumesAdminNegativeTest-1660961456 tempest-VolumesAdminNegativeTest-1660961456-project-member] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_rules [ 791.733938] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_rules [ 791.734276] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.734406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.734466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.734721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.734805] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.893683] env[69238]: INFO networking_nsxv3.common.synchronization [None req-624873ab-d619-4774-be7f-a8f74bb088e5 tempest-VolumesAdminNegativeTest-1660961456 tempest-VolumesAdminNegativeTest-1660961456-project-member] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_rules [ 791.894372] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_rules [ 791.894550] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.894649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.999707] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd54b12e-0bab-45ae-a778-97e3e57f18be [ 792.000364] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.000650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.000650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.000817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.000916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.001027] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd54b12e-0bab-45ae-a778-97e3e57f18be already deleted. [ 792.001120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd54b12e-0bab-45ae-a778-97e3e57f18be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.263718] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.264948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.264948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.264948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.264948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.264948] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23d3814-f79b-4992-979c-27687860c2ee already deleted. [ 792.264948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.264948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.264948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.264948] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.791871] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.791871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.791871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.791871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.791871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.792067] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23d3814-f79b-4992-979c-27687860c2ee already deleted. [ 792.792067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.878337] env[69238]: INFO networking_nsxv3.common.synchronization [req-666d82a6-fe67-4843-92ed-37e462b32b7a req-ed93df99-e698-4798-927e-d50c772323dd service nova] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_rules [ 792.878337] env[69238]: INFO networking_nsxv3.common.synchronization [req-666d82a6-fe67-4843-92ed-37e462b32b7a req-ed93df99-e698-4798-927e-d50c772323dd service nova] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 792.878337] env[69238]: INFO networking_nsxv3.common.synchronization [req-666d82a6-fe67-4843-92ed-37e462b32b7a req-ed93df99-e698-4798-927e-d50c772323dd service nova] Enqueued Resource ID: dafa1dde-bbda-48ab-962b-c86044ca41c6 with Priority: HIGHEST for action port [ 792.879960] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_rules [ 792.880438] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 792.880438] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafa1dde-bbda-48ab-962b-c86044ca41c6 with Priority: HIGHEST for action port [ 792.880634] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.880634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.880725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.880884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.880975] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.881976] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.881976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.882181] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-dafa1dde-bbda-48ab-962b-c86044ca41c6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.882276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.882336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.886024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.886024] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dafa1dde-bbda-48ab-962b-c86044ca41c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.143117] env[69238]: INFO networking_nsxv3.common.synchronization [req-fc8e06b5-6e73-4510-82d4-93bbc4f90855 req-cc3208f2-3ebf-4863-8814-4c7825618576 tempest-InstanceActionsV221TestJSON-1229699798 tempest-InstanceActionsV221TestJSON-1229699798-project-member] Enqueued Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_members [ 793.143735] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_members [ 793.144318] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9501cdef-a5a1-4d58-9c4f-32f41304e816 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.145403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.145497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.145795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.145998] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.146139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.146227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.146415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.146529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.146662] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.385270] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.385270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.389368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dafa1dde-bbda-48ab-962b-c86044ca41c6 with status ACTIVE [ 793.389368] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.389368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.389368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.389753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.389824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.390026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.390166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.390259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.390467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.390575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.391296] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.391296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.391296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.391296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.392825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.393242] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dafa1dde-bbda-48ab-962b-c86044ca41c6 is going to be updated. [ 793.407471] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: SUCCESS [ 793.408201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.408818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.409433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.409512] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.409745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.409802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.410722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.410878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.411044] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.416791] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.416951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.417060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.417272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.417451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.417661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dafa1dde-bbda-48ab-962b-c86044ca41c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.653760] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.653954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.654771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.654771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.654771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.654771] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.655060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.655060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.655648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.655648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.655648] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 already deleted. [ 793.655813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.900257] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.900480] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-994" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.903840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-994" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.903840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-994" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.903840] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.903840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.903840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.903840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.903840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.903840] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.903840] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.903840] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.903840] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.903840] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.903840] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.903840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.915168] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.924295] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.924491] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 793.924646] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.924831] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-994" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.925296] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-429bdc86-f63c-4205-9f1f-0c7dd8324d22 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.925494] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.925635] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.925995] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.926285] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429bdc86-f63c-4205-9f1f-0c7dd8324d22',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.347224] env[69238]: INFO networking_nsxv3.common.synchronization [None req-85a23b11-f728-4327-8b0a-9b2bb1fb65cf None None] Enqueued Resource ID: 2ad59731-5c42-4e3d-a09e-1d051353f67e with Priority: HIGHEST for action port [ 794.347908] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad59731-5c42-4e3d-a09e-1d051353f67e with Priority: HIGHEST for action port [ 794.348243] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ad59731-5c42-4e3d-a09e-1d051353f67e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.348372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ad59731-5c42-4e3d-a09e-1d051353f67e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.348438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ad59731-5c42-4e3d-a09e-1d051353f67e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.348754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ad59731-5c42-4e3d-a09e-1d051353f67e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.348832] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ad59731-5c42-4e3d-a09e-1d051353f67e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.423074] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.430826] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.430826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.430826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.430826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.430826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.430826] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 429bdc86-f63c-4205-9f1f-0c7dd8324d22 not found, creating... [ 794.431034] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.431328] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.431492] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.431837] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.433734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.434191] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.434404] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.434678] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.434951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.436078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.436542] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 429bdc86-f63c-4205-9f1f-0c7dd8324d22 is going to be created. [ 794.461457] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.461885] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.462034] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.462578] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.462928] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.463391] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.850540] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ad59731-5c42-4e3d-a09e-1d051353f67e [ 794.851700] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.851700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.851700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.851700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.851700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.851955] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ad59731-5c42-4e3d-a09e-1d051353f67e already deleted. [ 794.851955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ad59731-5c42-4e3d-a09e-1d051353f67e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.926019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.926245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.926245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.926769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.926769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.926769] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc is going to be updated. [ 794.968262] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.968409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.968475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.968683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.968829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.979937] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: IN_PROGRESS for 2s [ 795.005078] env[69238]: INFO networking_nsxv3.common.synchronization [req-c7c3fb68-2ad8-4c28-b45c-218ff803de75 req-ed42b610-b9e8-423a-8952-8204f44f186b tempest-TenantUsagesTestJSON-1548457129 tempest-TenantUsagesTestJSON-1548457129-project-member] Enqueued Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_members [ 795.005078] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGHEST for action security_group_members [ 795.005613] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.005875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.006042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.006891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.007186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.007446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.007620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.007905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.008101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.008282] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.306180] env[69238]: INFO networking_nsxv3.common.synchronization [req-6cfd4733-fb33-4223-b241-7f71c6bd9cfd req-68b96360-e3a8-4b62-a176-e98eeb843f98 tempest-ServersTestBootFromVolume-656707009 tempest-ServersTestBootFromVolume-656707009-project-member] Enqueued Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_members [ 795.306807] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_members [ 795.310480] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-69fbfff4-4d12-49da-9085-7d562819c005 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.310906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.310906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.311272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.311879] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.311879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.311879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.312253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.312253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.313248] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.594204] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.594555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.594555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.594638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.594702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.594921] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.595037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.595098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.595315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.595424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.595457] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 is going to be updated. [ 795.628302] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.628450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.628560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.628728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.628871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.640680] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 in Status: IN_PROGRESS for 2s [ 795.715913] env[69238]: INFO networking_nsxv3.common.synchronization [req-fc8e06b5-6e73-4510-82d4-93bbc4f90855 req-1456f1bb-7396-4fa4-8f65-9943ca779964 service nova] Enqueued Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_rules [ 795.717168] env[69238]: INFO networking_nsxv3.common.synchronization [req-fc8e06b5-6e73-4510-82d4-93bbc4f90855 req-1456f1bb-7396-4fa4-8f65-9943ca779964 service nova] Enqueued Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_members [ 795.717168] env[69238]: INFO networking_nsxv3.common.synchronization [req-fc8e06b5-6e73-4510-82d4-93bbc4f90855 req-1456f1bb-7396-4fa4-8f65-9943ca779964 service nova] Enqueued Resource ID: 429bdc86-f63c-4205-9f1f-0c7dd8324d22 with Priority: HIGHEST for action port [ 795.720507] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_rules [ 795.720507] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_members [ 795.720507] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429bdc86-f63c-4205-9f1f-0c7dd8324d22 with Priority: HIGHEST for action port [ 795.723052] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9501cdef-a5a1-4d58-9c4f-32f41304e816 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.723052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.723052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.723052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.724367] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.725222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9501cdef-a5a1-4d58-9c4f-32f41304e816 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.725358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.725358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.725549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.725694] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.725781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.725839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.725969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.726129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.726188] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.728582] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-429bdc86-f63c-4205-9f1f-0c7dd8324d22 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.728582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.728582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.728582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.728582] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429bdc86-f63c-4205-9f1f-0c7dd8324d22',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.770164] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.770365] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-12" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.770489] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-12" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.770894] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-12" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.771579] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.771689] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.771833] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.772093] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.772184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.772387] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.772905] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.772905] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.772905] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.772905] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.772905] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.773192] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.792862] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.793037] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.793317] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.793584] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-12" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.793911] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-df36ccab-41a3-4d4c-a03c-750863d86915 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.794111] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.794233] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.794977] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.794977] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df36ccab-41a3-4d4c-a03c-750863d86915',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.817833] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.818698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.818698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.818698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.818698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.818928] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.818928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.819041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.819310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.819310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.819560] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69fbfff4-4d12-49da-9085-7d562819c005 already deleted. [ 795.819560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.230525] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.231613] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9501cdef-a5a1-4d58-9c4f-32f41304e816 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.231721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.233279] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 429bdc86-f63c-4205-9f1f-0c7dd8324d22 with status ACTIVE [ 796.233728] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.233728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.233728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.234337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.234337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.234337] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.234337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.234337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.234482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.234482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.234945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.234945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.234945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.234945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.235241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.235241] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 429bdc86-f63c-4205-9f1f-0c7dd8324d22 is going to be updated. [ 796.262699] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.262699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.262699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.262852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.262957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.263141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429bdc86-f63c-4205-9f1f-0c7dd8324d22" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.277463] env[69238]: INFO networking_nsxv3.common.synchronization [None req-8fe40a45-b765-4ad9-a538-d6bae77269e4 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 796.278131] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 796.278410] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.278525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.278590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.278840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.278917] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.299104] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.299396] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.300078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.300078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.300078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.300390] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port df36ccab-41a3-4d4c-a03c-750863d86915 not found, creating... [ 796.300565] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.300740] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.300878] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.302585] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.302777] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.303122] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.303350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.303402] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.303657] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.303798] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.303942] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: df36ccab-41a3-4d4c-a03c-750863d86915 is going to be created. [ 796.330558] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.330861] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.331035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.331352] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.331597] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.331843] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.464446] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c261c89d-3573-45fd-a0c9-0ce1e5a595c0 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 796.467317] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 796.467317] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.467317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.733388] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.802369] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.803289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.803905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.804644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.804893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.805547] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f87108-657a-479d-b25c-126bec380d7f already deleted. [ 796.805743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.807729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.807729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.807729] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.994308] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: SUCCESS [ 796.995030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.996173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.996173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.996173] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.996173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.996173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.997226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.997226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.997226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.997226] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.193454] env[69238]: INFO networking_nsxv3.common.synchronization [req-6cfd4733-fb33-4223-b241-7f71c6bd9cfd req-4e853198-7dd7-48fc-9020-fd7fa88be41e service nova] Enqueued Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_rules [ 797.193636] env[69238]: INFO networking_nsxv3.common.synchronization [req-6cfd4733-fb33-4223-b241-7f71c6bd9cfd req-4e853198-7dd7-48fc-9020-fd7fa88be41e service nova] Enqueued Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_members [ 797.193774] env[69238]: INFO networking_nsxv3.common.synchronization [req-6cfd4733-fb33-4223-b241-7f71c6bd9cfd req-4e853198-7dd7-48fc-9020-fd7fa88be41e service nova] Enqueued Resource ID: df36ccab-41a3-4d4c-a03c-750863d86915 with Priority: HIGHEST for action port [ 797.196895] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_rules [ 797.197362] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_members [ 797.197362] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df36ccab-41a3-4d4c-a03c-750863d86915 with Priority: HIGHEST for action port [ 797.197492] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69fbfff4-4d12-49da-9085-7d562819c005 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.197743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.197743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.197854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.197897] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.198807] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-69fbfff4-4d12-49da-9085-7d562819c005 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.198923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.199029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.199207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.199375] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.199502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.199537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.199805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.199805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.199805] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.203047] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-df36ccab-41a3-4d4c-a03c-750863d86915 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.203047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.203047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.203047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.203047] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df36ccab-41a3-4d4c-a03c-750863d86915',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.238440] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.241035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.241035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.241035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.241035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.241035] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 is going to be created. [ 797.274205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.274205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.274205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.274205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.274205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.289968] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 in Status: UNINITIALIZED for 2s [ 797.332666] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.332885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.332960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.333411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.333600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.333709] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f87108-657a-479d-b25c-126bec380d7f already deleted. [ 797.333794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.412468] env[69238]: INFO networking_nsxv3.common.synchronization [None req-ab464b73-0534-4c10-a903-5c8b95bbb4da None None] Enqueued Resource ID: a1242053-6194-4a16-8e5a-149b5187bda0 with Priority: HIGHEST for action port [ 797.416326] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1242053-6194-4a16-8e5a-149b5187bda0 with Priority: HIGHEST for action port [ 797.418377] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1242053-6194-4a16-8e5a-149b5187bda0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.418377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1242053-6194-4a16-8e5a-149b5187bda0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.418377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1242053-6194-4a16-8e5a-149b5187bda0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.418377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1242053-6194-4a16-8e5a-149b5187bda0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.418377] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1242053-6194-4a16-8e5a-149b5187bda0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.503450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.503611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.503669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.503896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.504094] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.504568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.504634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.505262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.505262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.505262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.505262] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.505262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.505530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.505530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.505681] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.505783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.505813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.508201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.508328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.508436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.508520] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.650966] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 in Status: SUCCESS [ 797.654265] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 deletion is rescheduled due to dependency. [ 797.654265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.707549] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.708684] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-69fbfff4-4d12-49da-9085-7d562819c005 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.708791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.711137] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df36ccab-41a3-4d4c-a03c-750863d86915 with status ACTIVE [ 797.711369] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.711492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.711556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.711781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.711882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.712089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.712176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.712247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.712410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.712484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.712697] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.712786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.712842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.713015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.713135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.713226] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df36ccab-41a3-4d4c-a03c-750863d86915 is going to be updated. [ 797.738518] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.738834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.738834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.739060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.739230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.739630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df36ccab-41a3-4d4c-a03c-750863d86915" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.921683] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1242053-6194-4a16-8e5a-149b5187bda0 [ 797.925025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.925025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.925025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.925025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.925025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.925025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1242053-6194-4a16-8e5a-149b5187bda0 already deleted. [ 797.925025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1242053-6194-4a16-8e5a-149b5187bda0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.013464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bf1f1-444a-46b5-b4a0-baa2f52159cc: rpc.has_security_group_logging(os_id): False [ 798.038397] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.042209] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.042209] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.042209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.042596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.042596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.042596] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.042596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.042596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.042750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.042902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.042902] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc is going to be updated. [ 798.117885] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.117885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.118058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.119034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.119034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.136745] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: IN_PROGRESS for 2s [ 798.154940] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-1a7f89b9-0d2f-4403-b0b9-1acc1196f586 tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 798.155663] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 798.156944] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.157133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.157227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.157563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.157703] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.157806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.157863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.158053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.158148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.158244] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.210437] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.514126] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.514362] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.514507] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.514884] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.515551] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.516241] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.516663] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.517023] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.517267] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.517549] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.517709] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.518581] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.518581] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.518581] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.518902] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.519029] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.545507] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.545697] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.545871] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.546133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.546501] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-49bbc057-256c-4e42-9c44-4e1e95ea4375 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.546699] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.546901] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.547612] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.547992] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bbc057-256c-4e42-9c44-4e1e95ea4375',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.661850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.661850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.661850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.661850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.661850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.663404] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.663404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.663404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.663404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.663404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.663404] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe already deleted. [ 798.663404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.712709] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.712936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.713026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.713274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.714299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.714299] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69fbfff4-4d12-49da-9085-7d562819c005 is going to be created. [ 798.742978] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.742978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.742978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.742978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.742978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.754343] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69fbfff4-4d12-49da-9085-7d562819c005 in Status: UNINITIALIZED for 2s [ 799.050353] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.050575] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.050699] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.051562] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.051562] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.051562] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 49bbc057-256c-4e42-9c44-4e1e95ea4375 not found, creating... [ 799.051562] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.051772] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.051826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.052083] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.053019] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.053019] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.053019] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.053019] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.053244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.053244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.053435] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 49bbc057-256c-4e42-9c44-4e1e95ea4375 is going to be created. [ 799.086797] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.087106] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.087170] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.087450] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.087706] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.087957] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.301746] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 in Status: SUCCESS [ 799.301746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.301746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.301746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.301746] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.301746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.301746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.302132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.302132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.302132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.302132] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.802404] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-a9c06e88-d3f8-4927-b3d1-5266ae84772f service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 799.803096] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-a9c06e88-d3f8-4927-b3d1-5266ae84772f service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 799.803349] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-a9c06e88-d3f8-4927-b3d1-5266ae84772f service nova] Enqueued Resource ID: 49bbc057-256c-4e42-9c44-4e1e95ea4375 with Priority: HIGHEST for action port [ 799.805298] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 799.805516] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 799.805662] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bbc057-256c-4e42-9c44-4e1e95ea4375 with Priority: HIGHEST for action port [ 799.805977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9501cdef-a5a1-4d58-9c4f-32f41304e816 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.806169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.806229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.806468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.808186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.808329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.808405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.808667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.808787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.808912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.809157] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9501cdef-a5a1-4d58-9c4f-32f41304e816 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.809330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.809391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.809922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.809922] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.809922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.810206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.810206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.810554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.810554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.810684] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.813498] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.813654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.813715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.814454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.814454] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.814995] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.815116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.815287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.815509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.815663] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.815764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.815816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.815959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.816055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.816144] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.817036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-49bbc057-256c-4e42-9c44-4e1e95ea4375 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.817143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.817188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.817341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.817417] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bbc057-256c-4e42-9c44-4e1e95ea4375',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.153689] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: SUCCESS [ 800.153689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.319872] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.321572] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9501cdef-a5a1-4d58-9c4f-32f41304e816: rpc.has_security_group_logging(os_id): False [ 800.322204] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.322323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.329371] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49bbc057-256c-4e42-9c44-4e1e95ea4375 with status ACTIVE [ 800.329599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.329704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.329761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.329996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.330106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.330283] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.330383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.330441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.330612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.330693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.330874] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.330964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.331031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.331173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.331245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.331705] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49bbc057-256c-4e42-9c44-4e1e95ea4375 is going to be updated. [ 800.345270] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.345558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.345608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.345859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.345964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.346179] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.346280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.346377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.346516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.346599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.346799] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.346896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.346941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.347093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.347169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.347350] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.347499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.347557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.347708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.347793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.348461] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 is going to be created. [ 800.357376] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.357531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.357594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.357799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.357939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.358128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49bbc057-256c-4e42-9c44-4e1e95ea4375" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.435910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.436073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.436169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.436365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.436583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451363] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 in Status: IN_PROGRESS for 2s [ 800.771581] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69fbfff4-4d12-49da-9085-7d562819c005 in Status: SUCCESS [ 800.771861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.772073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.772309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.772555] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.772666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.772730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.772903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.772977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.773078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.773193] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.824031] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.275463] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.307048] env[69238]: INFO networking_nsxv3.common.synchronization [None req-96115838-d65a-47b6-81e0-4c4cac4bd730 tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: c7da0a0f-3244-4987-a852-4289d7832d2e with Priority: HIGHEST for action security_group_rules [ 801.307048] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7da0a0f-3244-4987-a852-4289d7832d2e with Priority: HIGHEST for action security_group_rules [ 801.308152] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7da0a0f-3244-4987-a852-4289d7832d2e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.310195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.310195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.310195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.310195] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7da0a0f-3244-4987-a852-4289d7832d2e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.331081] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.331081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.331081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.331081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.331081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.331081] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be created. [ 801.368048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.368048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.368048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.368048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.368048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.378642] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: UNINITIALIZED for 2s [ 801.460858] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e259067e-e3db-414f-81c6-7d9a030e9d50 tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: c7da0a0f-3244-4987-a852-4289d7832d2e with Priority: HIGHEST for action security_group_rules [ 801.460910] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7da0a0f-3244-4987-a852-4289d7832d2e with Priority: HIGHEST for action security_group_rules [ 801.463040] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7da0a0f-3244-4987-a852-4289d7832d2e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.463040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.779437] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69fbfff4-4d12-49da-9085-7d562819c005: rpc.has_security_group_logging(os_id): False [ 801.810568] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.810710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.810778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.810997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.811145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.811345] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.811448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.811500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.811763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.811801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.811903] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69fbfff4-4d12-49da-9085-7d562819c005 is going to be created. [ 801.854488] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.854488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.854865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.854911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.855179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.855341] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7da0a0f-3244-4987-a852-4289d7832d2e already deleted. [ 801.855497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.855728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.856059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.856206] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7da0a0f-3244-4987-a852-4289d7832d2e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.922202] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.922202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.922202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.922202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.922202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.949333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69fbfff4-4d12-49da-9085-7d562819c005 in Status: IN_PROGRESS for 2s [ 802.384391] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.384557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.384609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.384833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.384906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.385054] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7da0a0f-3244-4987-a852-4289d7832d2e already deleted. [ 802.385183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7da0a0f-3244-4987-a852-4289d7832d2e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.466029] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 in Status: SUCCESS [ 802.466216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.391802] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 803.392125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.392251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.392516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.392723] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.392838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.392900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.393082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.393379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.393379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.393379] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.898114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.898114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.898114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.898114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.898114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.898114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.898114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.898678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.898678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.898778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.898989] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.899780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.899780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.899780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.899780] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.899780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.899780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.900184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.900184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.900373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.900544] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.966593] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69fbfff4-4d12-49da-9085-7d562819c005 in Status: SUCCESS [ 803.967538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.407855] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17abedf8-39e0-48a5-82ba-2806c6053ebe: rpc.has_security_group_logging(os_id): False [ 804.435859] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.437202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.437331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.437572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.437719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.438258] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.438425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.438515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.438715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.438828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.439099] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.439225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.439317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.439728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.439840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.440085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.440215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.440280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.440452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.440554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.440907] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be created. [ 804.543930] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.544321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.544321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.544618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.545144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.572351] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 805.487286] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-b4cfa9bb-c9d7-4997-b644-593ef142dad1 tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 805.487286] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 805.487650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.487708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.487802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.487966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.488687] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.488687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.488687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.488687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.488687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.488687] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.906325] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.906512] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.906639] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.906907] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.907174] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.907360] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.908026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.908291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.908453] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.908453] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.908453] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.909102] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.909102] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.909296] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.909296] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.909421] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.932151] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.932384] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.932384] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.932645] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.932988] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-68d144eb-6e12-4413-922e-c34d5cc971ed taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.933278] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.933278] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.933696] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.933914] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d144eb-6e12-4413-922e-c34d5cc971ed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.992751] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.436954] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.437179] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.437305] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.440136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.440136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.440136] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 68d144eb-6e12-4413-922e-c34d5cc971ed not found, creating... [ 806.440136] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.440136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.440136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.440136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.440136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.440136] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.440136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.440550] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.440550] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.440550] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.440550] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 68d144eb-6e12-4413-922e-c34d5cc971ed is going to be created. [ 806.475835] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.478198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.478198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.478198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.478198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.478198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.495880] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.590274] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 806.590274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.000767] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.001113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.001113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.001255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.001531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.001647] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 807.052283] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.052283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.052283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.052283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.052283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.063355] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 807.228521] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-659b5a41-a55a-4697-bd31-6f7f6670b345 service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 807.228722] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-659b5a41-a55a-4697-bd31-6f7f6670b345 service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 807.228860] env[69238]: INFO networking_nsxv3.common.synchronization [req-07cd5280-de3c-4ce9-ab20-7bdc77b1067c req-659b5a41-a55a-4697-bd31-6f7f6670b345 service nova] Enqueued Resource ID: 68d144eb-6e12-4413-922e-c34d5cc971ed with Priority: HIGHEST for action port [ 807.229119] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 807.229251] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 807.229349] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68d144eb-6e12-4413-922e-c34d5cc971ed with Priority: HIGHEST for action port [ 807.229945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.230360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.230456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.230692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.230750] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.232190] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.232296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.232512] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-68d144eb-6e12-4413-922e-c34d5cc971ed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.232618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.234024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.234258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.234348] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d144eb-6e12-4413-922e-c34d5cc971ed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.732846] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.732846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.737433] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68d144eb-6e12-4413-922e-c34d5cc971ed with status ACTIVE [ 807.737908] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.739443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.740084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.740582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.742513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.742513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.742513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.742513] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68d144eb-6e12-4413-922e-c34d5cc971ed is going to be updated. [ 807.774241] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.774241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.774241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.774241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.774241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.774241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68d144eb-6e12-4413-922e-c34d5cc971ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.925337] env[69238]: INFO networking_nsxv3.common.synchronization [req-7b2fe54e-e75a-4e0c-8f30-f973f7f5743e req-d6405540-e040-45bd-b846-167024567ef9 tempest-InstanceActionsV221TestJSON-1229699798 tempest-InstanceActionsV221TestJSON-1229699798-project-member] Enqueued Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_members [ 807.928262] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 with Priority: HIGHEST for action security_group_members [ 807.928262] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9501cdef-a5a1-4d58-9c4f-32f41304e816 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.928262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.928262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.928262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.928262] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.928262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.928262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.928262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.928262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.928262] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9501cdef-a5a1-4d58-9c4f-32f41304e816',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.972403] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5e2bfbe7-3e1f-432b-a109-6d621ad2f6f9 None None] Enqueued Resource ID: 2eec1a68-a689-4a05-a4c0-18b2677e8a80 with Priority: HIGHEST for action port [ 807.973749] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eec1a68-a689-4a05-a4c0-18b2677e8a80 with Priority: HIGHEST for action port [ 807.975248] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eec1a68-a689-4a05-a4c0-18b2677e8a80 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.975248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eec1a68-a689-4a05-a4c0-18b2677e8a80" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.975248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eec1a68-a689-4a05-a4c0-18b2677e8a80" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.975248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eec1a68-a689-4a05-a4c0-18b2677e8a80" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.975248] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eec1a68-a689-4a05-a4c0-18b2677e8a80',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.433472] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.434022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.434671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.434671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.434671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.435085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.435269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.435439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.436164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.436164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.437098] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 is going to be updated. [ 808.476937] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2eec1a68-a689-4a05-a4c0-18b2677e8a80 [ 808.477113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.477248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.477316] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.477828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.477933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.477994] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2eec1a68-a689-4a05-a4c0-18b2677e8a80 already deleted. [ 808.478650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eec1a68-a689-4a05-a4c0-18b2677e8a80" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.516109] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.516109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.516109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.516603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.516996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.531741] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 in Status: IN_PROGRESS for 2s [ 809.077806] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 809.077806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.077806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.077806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.077806] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.077806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.077806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.077806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.077806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.077806] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.580410] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.083523] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.522781] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b9c3cc6d-56f1-498c-84e6-a433129a7b01 None None] Enqueued Resource ID: 9d99cb43-77f9-44d6-b39a-8f3bf45375e5 with Priority: HIGHEST for action port [ 810.524231] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d99cb43-77f9-44d6-b39a-8f3bf45375e5 with Priority: HIGHEST for action port [ 810.524820] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d99cb43-77f9-44d6-b39a-8f3bf45375e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.525095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d99cb43-77f9-44d6-b39a-8f3bf45375e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.525289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d99cb43-77f9-44d6-b39a-8f3bf45375e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.525918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d99cb43-77f9-44d6-b39a-8f3bf45375e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.526214] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d99cb43-77f9-44d6-b39a-8f3bf45375e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.546219] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 in Status: SUCCESS [ 810.546436] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9501cdef-a5a1-4d58-9c4f-32f41304e816 deletion is rescheduled due to dependency. [ 810.546557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9501cdef-a5a1-4d58-9c4f-32f41304e816" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.589381] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.589381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.589381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.589714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.589885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.589942] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 810.629032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.629032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.629032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.629032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.629032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.640880] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 810.778237] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-cfeeb8a0-2431-41ce-937a-8430936f0f0d tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 810.778237] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 810.778237] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.778237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.778237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.778237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.778237] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.778237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.778879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.778879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.778879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.778879] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.034653] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d99cb43-77f9-44d6-b39a-8f3bf45375e5 [ 811.034653] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.034653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.034653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.034653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.034653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.034653] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d99cb43-77f9-44d6-b39a-8f3bf45375e5 already deleted. [ 811.034653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d99cb43-77f9-44d6-b39a-8f3bf45375e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.112125] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-dcbe4e57-eaae-445a-8159-5ac9d83bbae9 tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 811.112125] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 811.114605] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.115796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.284092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.284319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.284490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.284700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.284876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.285244] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.285513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.285754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.285973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.286759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.286916] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 already deleted. [ 811.287072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.287475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.287720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.287948] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.288102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.288196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.288402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.288505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.288772] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.468443] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-1f71313c-1343-40e9-b2c8-4ec5d543417d tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 811.469339] env[69238]: INFO networking_nsxv3.common.synchronization [req-e9f487bf-098d-4372-b137-8e20482e3d66 req-0cf4cb77-c9b0-46a7-b8eb-c8d0f31c4872 tempest-ServersAdminNegativeTestJSON-838199429 tempest-ServersAdminNegativeTestJSON-838199429-project-member] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 811.471727] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 811.473210] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGHEST for action security_group_members [ 811.473210] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.473210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.473210] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.473210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.473210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.473210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.473210] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.475094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.475094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.475233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.475312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.475404] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.791587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.791767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.791821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.792124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.792124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.792320] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.792416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.792480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.792618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.792687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.792766] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 already deleted. [ 811.792842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.793053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.793157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.793296] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.793387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.793505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.794259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.794364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.794464] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.819810] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-47 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.819984] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.820184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.820441] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.820698] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.820856] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.820970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.821190] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.821334] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.821539] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.821648] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.821754] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.821858] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.821960] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.822073] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.822202] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.843938] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.844206] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 811.844350] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.844563] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.844904] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-3898cc46-492c-451b-820c-fcea51a4945a taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.845098] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.845253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.845616] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.845731] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3898cc46-492c-451b-820c-fcea51a4945a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.978546] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.978739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.978788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.978979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.979094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.979293] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.979392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.979455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.979607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.979686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.979773] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be updated. [ 812.038565] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.038721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.038783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.038995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.039168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.050698] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: IN_PROGRESS for 2s [ 812.297304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.297739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.297739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.297739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.297930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.298328] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.298328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.298328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.298328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.298621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.298621] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 already deleted. [ 812.298621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.354356] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.354654] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.354729] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.354980] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.355151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.355314] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 3898cc46-492c-451b-820c-fcea51a4945a not found, creating... [ 812.355661] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.355861] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.355927] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.356164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.356319] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.356555] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.356716] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.356977] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.360057] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.360057] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.360057] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 3898cc46-492c-451b-820c-fcea51a4945a is going to be created. [ 812.380800] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.382312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.382444] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.382776] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.383146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.383437] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.682745] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 812.683524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.683524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.684145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.684778] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.684778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.684778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.685141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.685563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.685985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.686353] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.773506] env[69238]: INFO networking_nsxv3.common.synchronization [req-36629d2d-0406-4197-819a-0374ab0870aa req-bb3f6f74-7556-4dc6-9e26-9f76e1f39b18 tempest-FloatingIPsAssociationTestJSON-1554317950 tempest-FloatingIPsAssociationTestJSON-1554317950-project-member] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 812.774276] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 812.775779] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.775779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.775779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.775929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.779043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.779043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.779043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.779043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.779043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.779043] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.192523] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.192703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.192775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.192998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.193704] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.193704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.193704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.193704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.193704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.193704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.194164] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.194164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.194164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.194164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.194357] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.194421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.194421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.194555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.194628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.194705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.194796] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.263132] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-c6c540f8-1c14-4f09-a394-8999335c4a10 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 813.263132] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-c6c540f8-1c14-4f09-a394-8999335c4a10 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 813.264398] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-c6c540f8-1c14-4f09-a394-8999335c4a10 service nova] Enqueued Resource ID: 3898cc46-492c-451b-820c-fcea51a4945a with Priority: HIGHEST for action port [ 813.264398] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 813.264928] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 813.265450] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3898cc46-492c-451b-820c-fcea51a4945a with Priority: HIGHEST for action port [ 813.265846] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.266025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.266109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.266427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.266568] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.268123] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.268123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.268123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.268123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.268818] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.269339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.269339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.269339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.269339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.269538] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.271561] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-3898cc46-492c-451b-820c-fcea51a4945a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.271561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.271723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.271778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.271953] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3898cc46-492c-451b-820c-fcea51a4945a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.282725] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.687029] env[69238]: INFO networking_nsxv3.common.synchronization [req-a2c5d902-04e3-4acf-9a80-ea726dafa285 req-b347e717-5385-478f-9e51-7ce0e8f4732d tempest-ServerMetadataNegativeTestJSON-1446096862 tempest-ServerMetadataNegativeTestJSON-1446096862-project-member] Enqueued Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_members [ 813.687029] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_members [ 813.687445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1190c58c-c48e-453c-afe1-9063beda849a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.687605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.687690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.687987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.688156] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.688284] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.688349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.688508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.688592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.688710] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.698969] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17abedf8-39e0-48a5-82ba-2806c6053ebe: rpc.has_security_group_logging(os_id): False [ 813.719808] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.719962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.720042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.720512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.720512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.720512] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.720675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.720675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.720808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.720878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.722023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.722361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.722361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.722361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.722468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.722591] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.722684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.724114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.724114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.724114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.724114] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 813.774081] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.775127] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.775240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.775442] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3898cc46-492c-451b-820c-fcea51a4945a with status ACTIVE [ 813.775653] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.775760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.775833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.776050] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.776126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.776295] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.776388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.776452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.776590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.776666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.776846] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.776934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.776997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.777235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.777301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.777384] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3898cc46-492c-451b-820c-fcea51a4945a is going to be updated. [ 813.788048] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.797012] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.797197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.797296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.797431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.797580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.803586] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.803586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.803586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.803774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.803810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.804076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3898cc46-492c-451b-820c-fcea51a4945a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.812427] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 814.066413] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf in Status: SUCCESS [ 814.066643] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf deletion is rescheduled due to dependency. [ 814.066797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.075306] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.075503] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.075656] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.076018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.076303] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.076505] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.076586] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.076838] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.076989] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.080371] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.080504] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.080619] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.080733] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.080847] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.080962] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.081160] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.144392] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.144575] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.144720] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.144901] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.145250] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.145424] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.145545] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.145936] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.146097] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea424f2d-2ca6-4291-8b51-fb21f98b5b30',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.190495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.190662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.190723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.191015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.191254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.191355] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.191464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.191521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.192648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.192648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.192648] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1190c58c-c48e-453c-afe1-9063beda849a already deleted. [ 814.192648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.282529] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.290464] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.291149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.291149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.291149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.291715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.291715] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc is going to be updated. [ 814.324412] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.324650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.324650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.324956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.325217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.337529] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: IN_PROGRESS for 2s [ 814.649028] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.649373] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.649573] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.649919] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.650162] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.650388] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port ea424f2d-2ca6-4291-8b51-fb21f98b5b30 not found, creating... [ 814.651594] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.651594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.651594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.651594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.651594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.651922] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.652196] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.652196] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.652471] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.652626] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.652816] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: ea424f2d-2ca6-4291-8b51-fb21f98b5b30 is going to be created. [ 814.677391] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.677661] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.677839] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.678271] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.678792] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.679043] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.776035] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.776035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-692" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.776035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-692" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.776035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-692" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.776035] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.776035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.776035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.776035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.776035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.776035] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.776035] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.777458] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.777810] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.778178] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.778506] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.778877] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.782846] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.783301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.783592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.784057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.787024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.787024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be created. [ 814.818248] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.820022] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.820022] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.820022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-692" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.820022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-06651916-7792-49aa-a2ee-5e9e01e8ee73 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.820850] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.821369] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.821941] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.824478] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06651916-7792-49aa-a2ee-5e9e01e8ee73',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.835020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.835020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.835020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.835020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.835020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.848868] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: UNINITIALIZED for 2s [ 815.326457] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.326772] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.326968] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.327328] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.327528] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.327725] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 06651916-7792-49aa-a2ee-5e9e01e8ee73 not found, creating... [ 815.328078] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.328415] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.328604] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.328885] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.329099] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.329520] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.329814] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.330097] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.330372] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.330553] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.330734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 06651916-7792-49aa-a2ee-5e9e01e8ee73 is going to be created. [ 815.333503] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-324c6035-b12b-4feb-839d-24f3ad0fb6c3 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 815.333899] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-324c6035-b12b-4feb-839d-24f3ad0fb6c3 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 815.334078] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-324c6035-b12b-4feb-839d-24f3ad0fb6c3 service nova] Enqueued Resource ID: ea424f2d-2ca6-4291-8b51-fb21f98b5b30 with Priority: HIGHEST for action port [ 815.335323] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 815.335323] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 815.335323] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea424f2d-2ca6-4291-8b51-fb21f98b5b30 with Priority: HIGHEST for action port [ 815.335735] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.335866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.336203] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.336203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.336904] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.336904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.336904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.336904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.336904] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea424f2d-2ca6-4291-8b51-fb21f98b5b30',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.359046] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.360320] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.360320] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.360320] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.360320] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.360320] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.830723] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 815.830723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.843041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea424f2d-2ca6-4291-8b51-fb21f98b5b30 with status ACTIVE [ 815.843041] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.843041] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.843041] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.843041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.843041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea424f2d-2ca6-4291-8b51-fb21f98b5b30 is going to be updated. [ 815.868369] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.868369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.868369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.868369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.868369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.868369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea424f2d-2ca6-4291-8b51-fb21f98b5b30" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.870387] env[69238]: INFO networking_nsxv3.common.synchronization [req-62ec447f-7da2-4dc2-b273-a23387abb5e3 req-b949e1c1-16eb-42f6-a4b8-30b0a5e353e0 tempest-ServersTestFqdnHostnames-543136473 tempest-ServersTestFqdnHostnames-543136473-project-member] Enqueued Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_members [ 815.871220] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3efc2ce-5009-447c-a310-4d3178a7395c with Priority: HIGHEST for action security_group_members [ 815.871715] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3efc2ce-5009-447c-a310-4d3178a7395c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.873021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.873021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.873021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.873021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.873021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.873021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.873021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.873021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.873021] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3efc2ce-5009-447c-a310-4d3178a7395c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.352840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: SUCCESS [ 816.353525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.378843] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.379797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.379948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.380263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.380517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.380742] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.380998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.382107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.382410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.382903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.383266] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3efc2ce-5009-447c-a310-4d3178a7395c is going to be updated. [ 816.418171] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.418494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.418618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.418879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.419045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.429333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3efc2ce-5009-447c-a310-4d3178a7395c in Status: IN_PROGRESS for 2s [ 816.732261] env[69238]: INFO networking_nsxv3.common.synchronization [req-a2c5d902-04e3-4acf-9a80-ea726dafa285 req-52fbedc9-8f39-4d45-a566-05d50cb01641 service nova] Enqueued Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_rules [ 816.732261] env[69238]: INFO networking_nsxv3.common.synchronization [req-a2c5d902-04e3-4acf-9a80-ea726dafa285 req-52fbedc9-8f39-4d45-a566-05d50cb01641 service nova] Enqueued Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_members [ 816.732261] env[69238]: INFO networking_nsxv3.common.synchronization [req-a2c5d902-04e3-4acf-9a80-ea726dafa285 req-52fbedc9-8f39-4d45-a566-05d50cb01641 service nova] Enqueued Resource ID: 06651916-7792-49aa-a2ee-5e9e01e8ee73 with Priority: HIGHEST for action port [ 816.732261] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_rules [ 816.732261] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_members [ 816.732261] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06651916-7792-49aa-a2ee-5e9e01e8ee73 with Priority: HIGHEST for action port [ 816.732941] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1190c58c-c48e-453c-afe1-9063beda849a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.733199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.733352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.733693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.733903] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.734922] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1190c58c-c48e-453c-afe1-9063beda849a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.735190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.735344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.735612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.735910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.737016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.737016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.737016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.737016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.737016] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.738182] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-06651916-7792-49aa-a2ee-5e9e01e8ee73 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.738488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.738663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.741496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.741496] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06651916-7792-49aa-a2ee-5e9e01e8ee73',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.789070] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-47 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.789294] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.789429] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.789718] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.789985] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.790260] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.790405] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.790655] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.790833] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.791093] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.791233] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.791365] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.791493] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.791625] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.791749] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.791966] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.016559] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 817.016916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.017205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.017442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.017704] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.017871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.018017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.018288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.018383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.018578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.018678] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.020536] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.020671] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.229 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 817.020860] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.021089] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-47" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.021446] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-8af4989a-b660-45c0-b0da-71c5a01baeaa taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.021625] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.021747] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.022215] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.022552] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8af4989a-b660-45c0-b0da-71c5a01baeaa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.027283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.027548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.027746] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.027868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.027932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.028135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.028228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.028331] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.243793] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1190c58c-c48e-453c-afe1-9063beda849a taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.243793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.243793] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.245403] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06651916-7792-49aa-a2ee-5e9e01e8ee73 with status ACTIVE [ 817.245569] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.247974] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.247974] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.247974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.247974] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06651916-7792-49aa-a2ee-5e9e01e8ee73 is going to be updated. [ 817.270740] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.271021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.271021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.271163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.271299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.271463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06651916-7792-49aa-a2ee-5e9e01e8ee73" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.530931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.530931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.531162] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.531336] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.532026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.532026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.532026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.532026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 8af4989a-b660-45c0-b0da-71c5a01baeaa not found, creating... [ 817.533211] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.533211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.533211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.533211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.533211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.536502] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.536727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.536899] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.537253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.537365] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.537746] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 8af4989a-b660-45c0-b0da-71c5a01baeaa is going to be created. [ 817.539399] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.560269] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.560550] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.560681] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.560981] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.561228] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.561461] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.744762] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.041663] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.248105] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.248105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.248105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.248105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.248105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.249028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1190c58c-c48e-453c-afe1-9063beda849a is going to be created. [ 818.284389] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.284389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.284389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.284389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.284389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.297938] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1190c58c-c48e-453c-afe1-9063beda849a in Status: UNINITIALIZED for 2s [ 818.404917] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-895429f9-e9fa-4823-97b4-b8130b731d45 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 818.405039] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-895429f9-e9fa-4823-97b4-b8130b731d45 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 818.405136] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff7514f7-fce5-4511-ab82-f2eddb5a15df req-895429f9-e9fa-4823-97b4-b8130b731d45 service nova] Enqueued Resource ID: 8af4989a-b660-45c0-b0da-71c5a01baeaa with Priority: HIGHEST for action port [ 818.405352] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 818.405484] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 818.405579] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8af4989a-b660-45c0-b0da-71c5a01baeaa with Priority: HIGHEST for action port [ 818.406141] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.406240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.406421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.406501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.406669] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-8af4989a-b660-45c0-b0da-71c5a01baeaa taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.406762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.406819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.407047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.407165] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8af4989a-b660-45c0-b0da-71c5a01baeaa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.439067] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3efc2ce-5009-447c-a310-4d3178a7395c in Status: SUCCESS [ 818.439233] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3efc2ce-5009-447c-a310-4d3178a7395c deletion is rescheduled due to dependency. [ 818.439336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3efc2ce-5009-447c-a310-4d3178a7395c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.549025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.549025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.549025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.549025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.549025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.549025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 818.586468] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.586651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.586726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.587014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.587133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.607480] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 818.913682] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8af4989a-b660-45c0-b0da-71c5a01baeaa with status ACTIVE [ 818.913961] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.914127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.914195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.914397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.914502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.914686] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.914784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.914845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.914995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.915087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.915277] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.915494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.915494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.915623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.915623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.915738] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8af4989a-b660-45c0-b0da-71c5a01baeaa is going to be updated. [ 818.937121] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.937333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.937423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.937621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.937793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.937960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8af4989a-b660-45c0-b0da-71c5a01baeaa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.269151] env[69238]: INFO networking_nsxv3.common.synchronization [req-972f20f0-580b-424a-b3ce-c1000e9f1eac req-59786677-4ba4-4e56-9bec-50c12b5ee93c tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 819.269661] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 819.269952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.273018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.273143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.273317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.273485] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.273590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.273665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.273819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.273907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.274009] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.508342] env[69238]: INFO networking_nsxv3.common.synchronization [req-63fcc62e-4e0e-4b65-bf1d-2ee79d5a6e0c req-012c23be-7717-4a4b-8846-869e85be964d tempest-ServerActionsV293TestJSON-586000412 tempest-ServerActionsV293TestJSON-586000412-project-member] Enqueued Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_members [ 819.508907] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGHEST for action security_group_members [ 819.509255] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.509375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.509440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.509632] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.509779] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.509974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.509974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.510081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.510192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.510286] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.629579] env[69238]: INFO networking_nsxv3.common.synchronization [req-906776c7-02a1-4c0a-81ca-252a9301a8a4 req-29e174fb-5514-41cb-9625-26d8178312a9 tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 819.630114] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 819.630413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.630533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.630591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.630793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.630961] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.631464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.631464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.631570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.631706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.631768] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.778211] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.013461] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.013674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.013742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.013952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.014362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.014362] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.014637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.014637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.014637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.014856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.014856] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 is going to be updated. [ 820.046991] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.047209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.047209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.047437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.047585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.058302] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01854ee2-08ca-46e9-8724-734e384f01a4 in Status: IN_PROGRESS for 2s [ 820.133961] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.282153] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.309052] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1190c58c-c48e-453c-afe1-9063beda849a in Status: SUCCESS [ 820.309275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.309759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.310023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.310220] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.310347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.310413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.310553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.310634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.310716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.310806] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.485089] env[69238]: INFO networking_nsxv3.common.synchronization [req-496552a2-4305-448d-9341-9ec9d175bf17 req-828b5f14-7543-4929-821e-5ed70dfe112c tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 820.485089] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 820.485089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.485089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.620172] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.622481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.622481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.622481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.622481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.623492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.623492] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.623844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.624075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.624243] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.624387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.624431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.624650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.624650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.624775] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.641538] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.786529] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.786529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.786529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.787153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.787153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.787342] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 820.804732] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.804945] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.805098] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.805425] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.805711] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.805961] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.806123] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.806371] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.806544] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.806795] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.806950] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.807101] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.807242] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.807377] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.807504] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.807660] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.819020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1190c58c-c48e-453c-afe1-9063beda849a taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819781] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1190c58c-c48e-453c-afe1-9063beda849a taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819781] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.819781] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.829751] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.829751] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.829751] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.829751] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-722" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.830030] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.830030] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.830123] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.830446] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.830587] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.841038] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 821.127826] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6bd121c-8d73-451b-96a4-3bfa5fbaad57: rpc.has_security_group_logging(os_id): False [ 821.128222] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.143251] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.143463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.143463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.143693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.143810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.143889] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 821.147561] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.147750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.147808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.148016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.148122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.148311] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.148412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.148474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.148627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.148703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.148898] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.148990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.149055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.149197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.149270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.149449] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.149537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.149591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.149723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.149798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.149879] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be created. [ 821.194211] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.194211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.194211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.194513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.194513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.215325] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 821.261450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.261450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.261450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.261450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.261450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.279317] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 821.323460] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1190c58c-c48e-453c-afe1-9063beda849a: rpc.has_security_group_logging(os_id): False [ 821.337946] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.338297] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.338413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.338688] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.338902] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.339028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 not found, creating... [ 821.339269] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.339441] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.339570] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.339767] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.339941] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.340403] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.340570] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.340688] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.340922] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.341084] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.341225] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 is going to be created. [ 821.367445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.367641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.367720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.367893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.367991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.372175] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.372355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.372418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.372630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.372720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.372940] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.373059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.373118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.373304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.373396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.373902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.373902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.373902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.373902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.373902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.374154] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1190c58c-c48e-453c-afe1-9063beda849a is going to be created. [ 821.412422] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.412633] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.415026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.415026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.415026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.415026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.536261] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.536648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.536754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.537441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.537703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.577769] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1190c58c-c48e-453c-afe1-9063beda849a in Status: IN_PROGRESS for 2s [ 821.631422] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.070592] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01854ee2-08ca-46e9-8724-734e384f01a4 in Status: SUCCESS [ 822.070592] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 deletion is rescheduled due to dependency. [ 822.070592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.134937] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.135121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.135246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.135403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.135490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.135580] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 822.181286] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.181472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.181529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.181728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.181874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.219039] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 822.352687] env[69238]: INFO networking_nsxv3.common.synchronization [req-906776c7-02a1-4c0a-81ca-252a9301a8a4 req-542660a1-f45a-4fff-a270-5057acb55760 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 822.352950] env[69238]: INFO networking_nsxv3.common.synchronization [req-906776c7-02a1-4c0a-81ca-252a9301a8a4 req-542660a1-f45a-4fff-a270-5057acb55760 service nova] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 822.353112] env[69238]: INFO networking_nsxv3.common.synchronization [req-906776c7-02a1-4c0a-81ca-252a9301a8a4 req-542660a1-f45a-4fff-a270-5057acb55760 service nova] Enqueued Resource ID: f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 with Priority: HIGHEST for action port [ 822.353386] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_rules [ 822.353563] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 822.353770] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 with Priority: HIGHEST for action port [ 822.354717] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.354859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.354889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.355111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.355189] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.356156] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.356335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.356601] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.356752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.356848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.357090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.357209] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.851753] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 822.852152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.852418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.852729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.853015] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.853731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.853731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.853731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.853731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.853906] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.859451] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.859597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.859754] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 with status ACTIVE [ 822.859977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.860114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.860177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.861114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.861114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.861114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.861114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.861114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.861114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.861114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.861720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.861720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.861720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.861720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.861720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.861720] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3 is going to be updated. [ 822.896647] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.896647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.896647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.896647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.896647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.896647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f06fd2cb-e38d-4ffa-aa85-c96272d6f7d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.229276] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 823.229618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.229838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.230128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.230345] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.230480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.230555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.230734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.230835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.231010] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.295441] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 823.295834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.296064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.296521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.296521] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.356293] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.356700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.356700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.356796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.356918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.357237] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.357352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.357459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.357661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.357786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.357912] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 823.387580] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.387580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.387800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.388689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.388689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.400968] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 823.598193] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1190c58c-c48e-453c-afe1-9063beda849a in Status: SUCCESS [ 823.598555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.733529] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.798942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.799158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.214017] env[69238]: INFO networking_nsxv3.common.synchronization [req-bc1bf497-c50b-4fac-a9f8-46d0250ead71 req-f6d81c74-0777-4955-8adc-aca3f2082b96 tempest-ListImageFiltersTestJSON-266287970 tempest-ListImageFiltersTestJSON-266287970-project-member] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 824.214990] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 824.214990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.214990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.215179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.215231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.216218] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.216329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.216393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.218067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.218067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.218067] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.229403] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 824.229632] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.229802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.230021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.230205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.230322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.230387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.230884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.230884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.230884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.230884] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.235478] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.722873] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.733706] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.734389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.734389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.734389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.735445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.735445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.735445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.735445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.735445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.735445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.735445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.735445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.735764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.735764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.735764] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.735919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.736088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.736386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.736386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.736386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.736615] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.739892] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.739892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.740118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.740156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.740390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.741180] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 824.787162] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.787319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.787361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.787580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.787772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.801303] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 825.227058] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.241173] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6bd121c-8d73-451b-96a4-3bfa5fbaad57: rpc.has_security_group_logging(os_id): False [ 825.278080] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.278344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.278344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.278734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.278734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.280113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.280113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.280113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.280113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.282224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.282417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.282503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.282605] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 825.363081] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.363258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.363297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.363514] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.363695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.380328] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 825.420644] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 825.420837] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe deletion is rescheduled due to dependency. [ 825.420957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.733563] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.734548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.734548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.734548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.734548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.734548] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed is going to be updated. [ 825.764296] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.764296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.764296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.764296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.764296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.777434] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: IN_PROGRESS for 2s [ 825.893091] env[69238]: INFO networking_nsxv3.common.synchronization [None req-950ed062-b947-402e-9e43-4706bb78beaa None None] Enqueued Resource ID: 6c7ad607-3752-440e-87aa-5bcd834c06b6 with Priority: HIGHEST for action port [ 825.893146] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c7ad607-3752-440e-87aa-5bcd834c06b6 with Priority: HIGHEST for action port [ 825.893732] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c7ad607-3752-440e-87aa-5bcd834c06b6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.893891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c7ad607-3752-440e-87aa-5bcd834c06b6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.893934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c7ad607-3752-440e-87aa-5bcd834c06b6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.895093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c7ad607-3752-440e-87aa-5bcd834c06b6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.895093] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c7ad607-3752-440e-87aa-5bcd834c06b6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.397076] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c7ad607-3752-440e-87aa-5bcd834c06b6 [ 826.397221] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.397489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.397489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.397618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.397720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.397831] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c7ad607-3752-440e-87aa-5bcd834c06b6 already deleted. [ 826.398060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c7ad607-3752-440e-87aa-5bcd834c06b6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.818350] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 826.819233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.819233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.823043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.823043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.823043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.823043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.823043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.823043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.823043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.823043] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.327213] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.327399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.327463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.327700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.327864] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.327971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.328035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.328250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.328317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.328406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.328565] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.328688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.328737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.328870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.329133] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.329133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.329218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.329296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.329402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.329476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.329562] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.394994] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 827.394994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.395572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.397121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.397121] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.789953] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: SUCCESS [ 827.790446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.831515] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0a6d09e-93ad-4f0a-b077-df666e70f18f: rpc.has_security_group_logging(os_id): False [ 827.849946] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.850161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.850303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.850406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.850515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.850746] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.850842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.850903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.851118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.851221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.851409] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.851501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.851561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.851715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.851801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.851980] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.852213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.852305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.852498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.852627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.852757] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 827.901099] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.901314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.901389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.901634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.901820] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.901958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.902062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.902241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.902336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.902464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.902567] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.924904] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.925093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.925171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.925393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.925545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.942659] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 828.223754] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5398ddb6-a202-4296-a63f-06b05cbdb23d None None] Enqueued Resource ID: 953663f6-99eb-41a2-9c60-6bdde8011eb3 with Priority: HIGHEST for action port [ 828.224084] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 953663f6-99eb-41a2-9c60-6bdde8011eb3 with Priority: HIGHEST for action port [ 828.224713] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-953663f6-99eb-41a2-9c60-6bdde8011eb3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.224834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-953663f6-99eb-41a2-9c60-6bdde8011eb3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.224912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-953663f6-99eb-41a2-9c60-6bdde8011eb3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.225665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-953663f6-99eb-41a2-9c60-6bdde8011eb3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.225761] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('953663f6-99eb-41a2-9c60-6bdde8011eb3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.407165] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.407329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.407370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.407593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.407786] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.407907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.407983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.408438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.408438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.408438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.408587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.408633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.408694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.408835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.408989] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.409111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.409174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.409326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.409454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.409546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.409633] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.492255] env[69238]: INFO networking_nsxv3.common.synchronization [req-488e427c-c373-4fc7-bf68-816ca309db6a req-cc63ae11-4fe9-45df-a9c8-dc5c9a26f0f8 tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 828.493313] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 828.493656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.497347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.497347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.497347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.497347] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.497347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.497347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.501288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.501288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.501288] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.728222] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 953663f6-99eb-41a2-9c60-6bdde8011eb3 [ 828.728548] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.728768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.728933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.729182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.729328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.729558] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:953663f6-99eb-41a2-9c60-6bdde8011eb3 already deleted. [ 828.729650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-953663f6-99eb-41a2-9c60-6bdde8011eb3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.915137] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6bd121c-8d73-451b-96a4-3bfa5fbaad57: rpc.has_security_group_logging(os_id): False [ 828.946752] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.949023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.949023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.949023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.949023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.949023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.949023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.949023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.949760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.949985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.950313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.953072] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.953072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.953072] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 829.000995] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.001203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.001259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.001522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.001641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.001879] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.002033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.002112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.002297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.002400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.002499] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 already deleted. [ 829.002613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.015663] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.015829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.015871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.016411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.016411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.032552] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 829.093207] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.093475] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.093632] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.094743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.095142] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.095387] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.095522] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.095888] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.096120] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.096401] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.096569] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.096748] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.096891] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.097122] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.097365] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.097537] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.119367] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.119599] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.119752] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.119938] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.120419] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.120611] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.120735] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.121151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.121297] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c18de30f-88d0-46e1-a647-3d2dbd2e0c7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.623803] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.624227] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.624787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.624787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.625572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.625572] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port c18de30f-88d0-46e1-a647-3d2dbd2e0c7f not found, creating... [ 829.625818] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.626102] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.626834] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.626834] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.626834] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.627050] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.627164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.627284] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.627586] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.627759] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.627926] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: c18de30f-88d0-46e1-a647-3d2dbd2e0c7f is going to be created. [ 829.648297] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.648630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.648759] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.649458] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.649610] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.649854] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.959464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 829.959798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.739071] env[69238]: INFO networking_nsxv3.common.synchronization [req-488e427c-c373-4fc7-bf68-816ca309db6a req-683f958d-7909-48f8-9370-3dcba05283f9 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 830.739261] env[69238]: INFO networking_nsxv3.common.synchronization [req-488e427c-c373-4fc7-bf68-816ca309db6a req-683f958d-7909-48f8-9370-3dcba05283f9 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 830.739396] env[69238]: INFO networking_nsxv3.common.synchronization [req-488e427c-c373-4fc7-bf68-816ca309db6a req-683f958d-7909-48f8-9370-3dcba05283f9 service nova] Enqueued Resource ID: c18de30f-88d0-46e1-a647-3d2dbd2e0c7f with Priority: HIGHEST for action port [ 830.739649] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 830.739813] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 830.739861] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c18de30f-88d0-46e1-a647-3d2dbd2e0c7f with Priority: HIGHEST for action port [ 830.743115] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.743115] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.743115] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.743115] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.743115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.743115] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.744209] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.744310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.744409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.744534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.744613] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c18de30f-88d0-46e1-a647-3d2dbd2e0c7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.049451] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 831.049955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.246685] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.246893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.247046] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.251766] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c18de30f-88d0-46e1-a647-3d2dbd2e0c7f with status ACTIVE [ 831.251863] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.251998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.252079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.252298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.252612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.252612] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.252727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.252727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.252830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.252928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.253126] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.253240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.253326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.253528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.253642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.253736] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c18de30f-88d0-46e1-a647-3d2dbd2e0c7f is going to be updated. [ 831.278197] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.278396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.278465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.278749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.278936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.279620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c18de30f-88d0-46e1-a647-3d2dbd2e0c7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.752414] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.258022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.258022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.258022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.258022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.258022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.258022] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be created. [ 832.286640] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.286823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.286823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.287111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.287296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.301705] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: UNINITIALIZED for 2s [ 832.490882] env[69238]: INFO networking_nsxv3.common.synchronization [req-f2ebc923-b5c2-4596-9d92-277f3795d27e req-3cc20a94-cc70-431a-b330-5e50c17d301e tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 832.492628] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 832.492628] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.492628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.492628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.492628] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.494561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.494561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.494561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.494561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.494561] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.985332] env[69238]: INFO networking_nsxv3.common.synchronization [req-f2ebc923-b5c2-4596-9d92-277f3795d27e req-c5b50fea-0168-4a98-ba2c-d931e413b6a7 tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 832.985867] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 832.986317] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.986453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.996070] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.359151] env[69238]: INFO networking_nsxv3.common.synchronization [req-06beac36-875d-4df2-ac8b-934b3bb420ea req-fd621933-7645-4a4d-ae3a-45858b304129 tempest-ServerMetadataNegativeTestJSON-1446096862 tempest-ServerMetadataNegativeTestJSON-1446096862-project-member] Enqueued Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_members [ 833.359761] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1190c58c-c48e-453c-afe1-9063beda849a with Priority: HIGHEST for action security_group_members [ 833.360966] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1190c58c-c48e-453c-afe1-9063beda849a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.361405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.361474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.361696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.361870] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.361975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.362054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.362208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.362436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.362544] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1190c58c-c48e-453c-afe1-9063beda849a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.498239] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.733378] env[69238]: INFO networking_nsxv3.common.synchronization [req-f2ebc923-b5c2-4596-9d92-277f3795d27e req-98288444-34cd-4cf9-8b69-ba2439b98e42 tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 833.733991] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 833.734321] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.734437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.865490] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.869025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.869025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.869025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1190c58c-c48e-453c-afe1-9063beda849a is going to be updated. [ 833.947495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.947667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.947772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.947980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.948134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.957858] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1190c58c-c48e-453c-afe1-9063beda849a in Status: IN_PROGRESS for 2s [ 834.000367] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.003106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.003106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.003106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.003106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.003106] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 834.033877] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.034077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.034151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.034395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.034546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.045475] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 834.316265] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 834.316265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.316403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.317036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.317036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.317036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.317036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.317351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.317351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.317351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.317527] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.822170] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.822170] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.822170] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.822170] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.822170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.823432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.823432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.823432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.823432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.823432] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.998498] env[69238]: INFO networking_nsxv3.common.synchronization [req-4bc5d59d-3ade-4d77-947f-6653cb76aa3b req-0c3a784c-8a93-467e-aecf-592dc8e68ed2 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_members [ 834.998775] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_members [ 834.999280] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.999280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.999280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.999525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.999679] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.999773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.999833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.999987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.001353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.001353] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.326983] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9df4a22-2e58-46f6-9dc8-bffb28401a54: rpc.has_security_group_logging(os_id): False [ 835.345059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.345215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.345276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.345466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.345545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.345807] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.345807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.345983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.346052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.346255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.346395] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.346707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.347781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.347781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.347781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.347781] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.347781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.347781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.347781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.347781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.348178] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be created. [ 835.407949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.408110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.408176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.408384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.408586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.435089] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 835.502714] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.502916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.503010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.504283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.504448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.504714] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.504829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.504896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.505137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.505260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.505308] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c already deleted. [ 835.505404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.970902] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1190c58c-c48e-453c-afe1-9063beda849a in Status: SUCCESS [ 835.971237] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1190c58c-c48e-453c-afe1-9063beda849a deletion is rescheduled due to dependency. [ 835.971384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1190c58c-c48e-453c-afe1-9063beda849a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.060958] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 836.060958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.060958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.060958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.060958] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.060958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.061465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.061465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.061465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.061465] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.094877] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.095080] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.095206] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.095535] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.095784] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.095934] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.096084] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.096325] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.096473] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.096680] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.096791] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.096896] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.097009] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.097131] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.097237] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.097370] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.118607] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.118847] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.118935] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.119117] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.119454] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.119626] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.119744] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.120145] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.120313] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.256805] env[69238]: INFO networking_nsxv3.common.synchronization [req-45711ed7-8116-4c25-82cc-8a98d4f6e589 req-a86aac0e-0a34-49e5-9a4e-2b4dda814e15 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 836.256805] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 836.256805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.256805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.256805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.256805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.256805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.256805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.256805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.256805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.256805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.257256] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.304835] env[69238]: INFO networking_nsxv3.common.synchronization [req-45711ed7-8116-4c25-82cc-8a98d4f6e589 req-a86aac0e-0a34-49e5-9a4e-2b4dda814e15 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 836.305039] env[69238]: INFO networking_nsxv3.common.synchronization [req-45711ed7-8116-4c25-82cc-8a98d4f6e589 req-a86aac0e-0a34-49e5-9a4e-2b4dda814e15 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 836.305943] env[69238]: INFO networking_nsxv3.common.synchronization [req-45711ed7-8116-4c25-82cc-8a98d4f6e589 req-a86aac0e-0a34-49e5-9a4e-2b4dda814e15 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with Priority: HIGHEST for action port [ 836.305943] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 836.305943] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 836.305943] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with Priority: HIGHEST for action port [ 836.306306] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.306458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.306548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.306772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.306884] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.307828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.307956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.308191] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.308319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.308440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.308620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.310206] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f231a88-0dca-4ef1-a08b-f7b7a603c0b9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.565987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.566256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.566359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.566577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.566699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.566980] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.567127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.567225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.567886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.567886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.567886] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 836.597703] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.597855] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.597855] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.598057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.598163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.606931] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 836.625760] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.626045] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.626252] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.626533] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.626692] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.626848] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a not found, creating... [ 836.627126] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.627286] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.627401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.627627] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.627765] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.628055] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.628238] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.628356] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.628585] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.628739] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.628858] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a is going to be created. [ 836.652978] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.653223] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.653350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.653636] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.653988] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.654481] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.759788] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.810763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.810894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.811539] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with status ACTIVE [ 836.811539] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.811713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.811713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.812580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.812580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.812580] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.812580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.813424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.813763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.813837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.814143] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.814265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.814873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.814873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.814873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.815019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 is going to be updated. [ 836.841441] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.841692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.841692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.841840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.841978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.842160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.265355] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.450909] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 837.450909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.771522] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.771522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.771522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.771522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.771522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.771522] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be updated. [ 837.810299] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.810299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.810299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.810299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.810299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.819677] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 837.857411] env[69238]: INFO networking_nsxv3.common.synchronization [req-4bc5d59d-3ade-4d77-947f-6653cb76aa3b req-991eaa97-b4d6-489b-9f10-a39b3677e559 service nova] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_rules [ 837.857411] env[69238]: INFO networking_nsxv3.common.synchronization [req-4bc5d59d-3ade-4d77-947f-6653cb76aa3b req-991eaa97-b4d6-489b-9f10-a39b3677e559 service nova] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_members [ 837.857411] env[69238]: INFO networking_nsxv3.common.synchronization [req-4bc5d59d-3ade-4d77-947f-6653cb76aa3b req-991eaa97-b4d6-489b-9f10-a39b3677e559 service nova] Enqueued Resource ID: b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a with Priority: HIGHEST for action port [ 837.862359] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_rules [ 837.862359] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_members [ 837.862359] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a with Priority: HIGHEST for action port [ 837.862359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.862359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.862359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.862359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.862359] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.864210] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.864579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.864812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.865211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.865543] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.866203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.868474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.868474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.868474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.868474] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.874625] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.874625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.874625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.874625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.874625] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.001309] env[69238]: INFO networking_nsxv3.common.synchronization [req-7d05b80b-7d57-413d-923a-17ac575f3a4a req-b374d5be-ae34-4353-990e-1cae1fa86275 tempest-ImagesOneServerTestJSON-560061222 tempest-ImagesOneServerTestJSON-560061222-project-member] Enqueued Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_members [ 838.001309] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_members [ 838.001309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.001309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.001309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.001309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.001309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.001309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.001309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.001309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.001909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.002110] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.374814] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.377292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.377292] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.378936] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a with status ACTIVE [ 838.379150] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.379279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.379611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.379611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.379712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.380345] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.380476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.380544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.380710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.380793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.380977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.381096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.381159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.381726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.381726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.381726] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a is going to be updated. [ 838.404044] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.404290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.404290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.404459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.404594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.404756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3aa7bbf-8ca6-4fe5-9c79-e2d502609d0a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.507897] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.508103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.508151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.508344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.508490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.508706] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.508801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.508840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.508976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.509064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.509148] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 already deleted. [ 838.509227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.618226] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 838.618514] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 deletion is rescheduled due to dependency. [ 838.618638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.618750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.618968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.619158] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.619268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.619330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.619482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.619562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.619650] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.883651] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.110029] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.110251] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-16" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.110419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-16" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.110740] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-16" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.111058] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.111558] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.111677] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.111892] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.112100] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.112361] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.112507] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.112624] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.112722] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.112835] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.112938] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.113083] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.125467] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.125621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.125684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.125890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.125981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.126253] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.126355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.126418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.126569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.126648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.126735] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 839.133938] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.134205] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.134332] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.134525] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-16" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.134839] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.135021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.135141] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.135690] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.135923] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b08e8ad3-7a73-4884-99bb-5d28f0a3f408',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.161610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.161805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.161847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.162189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.162307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.171166] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 839.391092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.391467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.391467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.391559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.391624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.391719] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c is going to be created. [ 839.421814] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.422015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.422015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.422229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.422381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.432618] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: UNINITIALIZED for 2s [ 839.641045] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.641195] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.642032] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.642032] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.642032] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.642032] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port b08e8ad3-7a73-4884-99bb-5d28f0a3f408 not found, creating... [ 839.642235] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.642292] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.642402] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.642618] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.642924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.643027] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.643187] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.643298] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.643630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.643630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.643752] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: b08e8ad3-7a73-4884-99bb-5d28f0a3f408 is going to be created. [ 839.666832] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.666832] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.666832] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.666832] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.667251] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.667251] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.836532] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 839.836856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.837260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.837520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.837768] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.837909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.837991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.838232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.838341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.838475] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.341124] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.462216] env[69238]: INFO networking_nsxv3.common.synchronization [req-406fd28c-9973-4ea4-833c-f99925d7b955 req-5287cb49-afa1-4038-878a-d8e393054431 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 840.462216] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 840.462917] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.463366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.523272] env[69238]: INFO networking_nsxv3.common.synchronization [req-406fd28c-9973-4ea4-833c-f99925d7b955 req-5287cb49-afa1-4038-878a-d8e393054431 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 840.523272] env[69238]: INFO networking_nsxv3.common.synchronization [req-406fd28c-9973-4ea4-833c-f99925d7b955 req-5287cb49-afa1-4038-878a-d8e393054431 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 840.523272] env[69238]: INFO networking_nsxv3.common.synchronization [req-406fd28c-9973-4ea4-833c-f99925d7b955 req-5287cb49-afa1-4038-878a-d8e393054431 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with Priority: HIGHEST for action port [ 840.523272] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_rules [ 840.523272] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 840.523272] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with Priority: HIGHEST for action port [ 840.523863] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.524134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.524531] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.524763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.525078] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.525318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.527779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.527779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.527779] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f231a88-0dca-4ef1-a08b-f7b7a603c0b9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.843771] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.028653] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 with status ACTIVE [ 841.029028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.029028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.029207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.029342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.029404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.029584] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.029687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.029763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.029912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.030009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.030196] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.030304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.030366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.030518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.030657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.030687] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f231a88-0dca-4ef1-a08b-f7b7a603c0b9 is going to be updated. [ 841.054359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.054594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.054594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.054777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.054908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.055083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f231a88-0dca-4ef1-a08b-f7b7a603c0b9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.108447] env[69238]: INFO networking_nsxv3.common.synchronization [req-7d05b80b-7d57-413d-923a-17ac575f3a4a req-705c9390-5e56-4fb2-a616-fa87562bf176 service nova] Enqueued Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_rules [ 841.108703] env[69238]: INFO networking_nsxv3.common.synchronization [req-7d05b80b-7d57-413d-923a-17ac575f3a4a req-705c9390-5e56-4fb2-a616-fa87562bf176 service nova] Enqueued Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_members [ 841.108848] env[69238]: INFO networking_nsxv3.common.synchronization [req-7d05b80b-7d57-413d-923a-17ac575f3a4a req-705c9390-5e56-4fb2-a616-fa87562bf176 service nova] Enqueued Resource ID: b08e8ad3-7a73-4884-99bb-5d28f0a3f408 with Priority: HIGHEST for action port [ 841.109499] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_rules [ 841.109623] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_members [ 841.109681] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b08e8ad3-7a73-4884-99bb-5d28f0a3f408 with Priority: HIGHEST for action port [ 841.110376] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.110526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.110583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.110832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.110913] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.111835] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.112015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.112015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.113107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.113107] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.113107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.113107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.113107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.113107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.113107] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.113805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.113929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.116088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.116088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.116088] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b08e8ad3-7a73-4884-99bb-5d28f0a3f408',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.182197] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 841.182423] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 deletion is rescheduled due to dependency. [ 841.182499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.346382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.346623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.346663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.346944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.347065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.347185] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be updated. [ 841.385619] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.385826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.385896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.386201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.386334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.405067] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 841.442596] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: SUCCESS [ 841.442833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.443014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.443247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.443441] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.443560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.443619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.443771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.443854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.443944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.444089] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.616599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.616924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.616924] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.620016] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b08e8ad3-7a73-4884-99bb-5d28f0a3f408 with status ACTIVE [ 841.620016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.620016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.620016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.620466] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.620466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.620466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.620627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.620627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.620707] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b08e8ad3-7a73-4884-99bb-5d28f0a3f408 is going to be updated. [ 841.645463] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.645656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.645720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.645929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.646344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.646344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b08e8ad3-7a73-4884-99bb-5d28f0a3f408" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.946907] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.123401] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.268777] env[69238]: INFO networking_nsxv3.common.synchronization [req-c710ae79-16bf-426a-ad73-767cb8d8c2ad req-96d5016a-9d1a-4cf7-aaeb-c63c5d04ab48 tempest-VolumesAdminNegativeTest-1660961456 tempest-VolumesAdminNegativeTest-1660961456-project-member] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_members [ 842.269372] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_members [ 842.269677] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.269801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.269874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.270420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.270589] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.270693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.270774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.270948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.271057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.271195] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.449376] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b44d3fc-7a43-4b31-850f-15e701b8ab7c: rpc.has_security_group_logging(os_id): False [ 842.468821] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.469062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.469062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.469297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.469394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.469648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.469745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.469806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.469955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.470043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.470131] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c is going to be created. [ 842.531477] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.531657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.531720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.531884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.532075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.545692] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: IN_PROGRESS for 2s [ 842.627736] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.628260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.628260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.628260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.628432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.628432] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 is going to be created. [ 842.675688] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.675899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.675899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.676124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.676365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.687569] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 in Status: UNINITIALIZED for 2s [ 842.774560] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.774560] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.774560] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23d3814-f79b-4992-979c-27687860c2ee already deleted. [ 842.774560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.993246] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.993246] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.993246] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.993246] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.993246] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.994668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.995082] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.996678] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.997154] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.997793] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.998051] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.998484] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.998936] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.999184] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.999392] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.000356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.021752] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.021879] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.022013] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.022218] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.022545] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-5edb4ee6-928c-46fa-83ce-0f6b355531a5 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.022706] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.022824] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.023211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.023305] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5edb4ee6-928c-46fa-83ce-0f6b355531a5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.421341] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.421341] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.421341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.421341] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.422213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.422213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.422213] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.422213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.422346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.423295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.423295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.423295] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.526712] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.526926] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.527214] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.527361] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.527518] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.527683] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 5edb4ee6-928c-46fa-83ce-0f6b355531a5 not found, creating... [ 843.528132] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.528132] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.528268] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.528514] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.528707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.529220] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.529475] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.529798] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.530078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.530315] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.530608] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 5edb4ee6-928c-46fa-83ce-0f6b355531a5 is going to be created. [ 843.555570] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.556409] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.556409] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.556409] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.556971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.556971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.924029] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.926918] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.429404] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af5e1a5e-9272-4c94-94cf-f661ba1cc217: rpc.has_security_group_logging(os_id): False [ 844.432334] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.448406] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.448548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.448646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.448851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.448942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.449203] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.449325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.449383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.449523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.449600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.449685] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be updated. [ 844.540095] env[69238]: INFO networking_nsxv3.common.synchronization [req-a21d714f-be29-4db8-b8b6-630752b8a608 req-6c73e446-8789-4063-8ce8-1b0781e12aa7 tempest-ServersV294TestFqdnHostnames-1544691138 tempest-ServersV294TestFqdnHostnames-1544691138-project-member] Enqueued Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_members [ 844.540647] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGHEST for action security_group_members [ 844.544037] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.545458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.545572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.546069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.546316] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.546634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.546729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.546995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.547355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.547503] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.562308] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: SUCCESS [ 844.562544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.577852] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.578122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.578122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.578324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.578420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.592848] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 844.704630] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 in Status: SUCCESS [ 844.705501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.705501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.705501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.705666] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.705666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.705764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.705921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.706376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.706376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.706376] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.821679] env[69238]: INFO networking_nsxv3.common.synchronization [req-c710ae79-16bf-426a-ad73-767cb8d8c2ad req-2b5adcdf-e29b-4410-9e54-633695dc86e0 service nova] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_rules [ 844.821837] env[69238]: INFO networking_nsxv3.common.synchronization [req-c710ae79-16bf-426a-ad73-767cb8d8c2ad req-2b5adcdf-e29b-4410-9e54-633695dc86e0 service nova] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_members [ 844.821979] env[69238]: INFO networking_nsxv3.common.synchronization [req-c710ae79-16bf-426a-ad73-767cb8d8c2ad req-2b5adcdf-e29b-4410-9e54-633695dc86e0 service nova] Enqueued Resource ID: 5edb4ee6-928c-46fa-83ce-0f6b355531a5 with Priority: HIGHEST for action port [ 844.822674] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_rules [ 844.822766] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_members [ 844.822828] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5edb4ee6-928c-46fa-83ce-0f6b355531a5 with Priority: HIGHEST for action port [ 844.823121] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.823209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.823247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.823455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.823533] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.825193] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.825193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.825193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.825337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.825634] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.825634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.825634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.829020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.829020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.829020] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.829020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-5edb4ee6-928c-46fa-83ce-0f6b355531a5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.829020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.829020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.829020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.829020] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5edb4ee6-928c-46fa-83ce-0f6b355531a5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.938375] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.939629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.939629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.939629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.939629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.939629] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be updated. [ 844.966810] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.966977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.967064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.967277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.967431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.979525] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 845.054085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.054342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.054342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.054602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.054697] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.054937] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.055064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.055064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.055189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.055272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.055359] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d84f347-c5bd-4943-8736-772c25927665 is going to be updated. [ 845.099751] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.099966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.099966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.100189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.100345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.111662] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d84f347-c5bd-4943-8736-772c25927665 in Status: IN_PROGRESS for 2s [ 845.211354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.211608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.211608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.211875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.212081] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.212214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.212214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.212306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.212398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.212776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.213048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.213173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.213572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.213572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.213572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.213708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.213754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.213868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.214014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.214106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.214250] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.330320] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.330481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.330664] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.331633] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5edb4ee6-928c-46fa-83ce-0f6b355531a5 with status ACTIVE [ 845.331840] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.331960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.332037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.332246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.332338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.332509] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.332604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.332666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.338043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.338043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.338043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.338043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.338043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.338043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.338043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.338043] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5edb4ee6-928c-46fa-83ce-0f6b355531a5 is going to be updated. [ 845.364035] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.364035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.364035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.364035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.364035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.364035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5edb4ee6-928c-46fa-83ce-0f6b355531a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.455305] env[69238]: INFO networking_nsxv3.common.synchronization [req-cbd1876b-a328-4dde-a335-7c1d6d9eeb6c req-a34ace1d-446a-4819-8da6-68ac1c1de41d tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 845.455907] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 845.456389] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.456594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.456594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.457073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.457160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.457227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.457271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.457640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.457640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.457640] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.716365] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7001fc5d-d888-45cf-bc02-9dae4d3e3335: rpc.has_security_group_logging(os_id): False [ 845.737316] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.737521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.737589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.738041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.738041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.738284] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.738434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.738510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.738687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.738834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.739049] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.739496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.739579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.739736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.740123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.741535] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.741535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.741692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.741843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.741995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.742209] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 is going to be created. [ 845.808757] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.808757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.808757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.808958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.809081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.826810] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 in Status: IN_PROGRESS for 2s [ 845.839335] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.960907] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.961349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.961349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.961920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.961920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.962285] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.962727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.963042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.963338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.964112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.964112] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f87108-657a-479d-b25c-126bec380d7f already deleted. [ 845.964112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.343408] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.343408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.343641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.343753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.343883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.343992] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23d3814-f79b-4992-979c-27687860c2ee is going to be created. [ 846.380024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.380024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.380024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.380024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.380024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.385720] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.387724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.387724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.387724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.387724] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.388232] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.388963] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.390123] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.393158] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.393158] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.393158] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.393158] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.393158] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.393158] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.393158] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.393158] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.396630] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: UNINITIALIZED for 2s [ 846.437312] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.437312] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 846.437312] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.437312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.437312] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-fff5175b-f505-4219-9ee6-3f473b395874 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.437312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.437312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.437312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.439373] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff5175b-f505-4219-9ee6-3f473b395874',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.610665] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 846.610903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.611100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.611429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.611429] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.942308] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.942608] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.942769] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.943077] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.943331] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.943377] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port fff5175b-f505-4219-9ee6-3f473b395874 not found, creating... [ 846.943647] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.943802] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.943940] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.944207] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.944383] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.944725] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.944909] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.945405] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.945773] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.946144] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.946317] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: fff5175b-f505-4219-9ee6-3f473b395874 is going to be created. [ 846.983319] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.983729] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.983729] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.984059] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.984299] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.984524] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.993776] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 846.994212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.994457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.994740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.994977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.995183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.995320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.995548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.995714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.995856] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.115167] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.115167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.129644] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d84f347-c5bd-4943-8736-772c25927665 in Status: IN_PROGRESS for 4s [ 847.274950] env[69238]: INFO networking_nsxv3.common.synchronization [None req-23cc01e0-9098-434a-82c9-011722916c29 None None] Enqueued Resource ID: aeca67d3-cefd-4bbb-886d-68b41684f702 with Priority: HIGHEST for action port [ 847.275527] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeca67d3-cefd-4bbb-886d-68b41684f702 with Priority: HIGHEST for action port [ 847.275858] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-aeca67d3-cefd-4bbb-886d-68b41684f702 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.276034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aeca67d3-cefd-4bbb-886d-68b41684f702" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.277761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aeca67d3-cefd-4bbb-886d-68b41684f702" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.278060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aeca67d3-cefd-4bbb-886d-68b41684f702" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.278144] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeca67d3-cefd-4bbb-886d-68b41684f702',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.281809] env[69238]: INFO networking_nsxv3.common.synchronization [req-800e9b20-300b-4049-b4b9-e1b787452bd4 req-1db207a2-a132-4313-af5b-933d709affe4 tempest-AttachInterfacesUnderV243Test-223471990 tempest-AttachInterfacesUnderV243Test-223471990-project-member] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 847.283020] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGHEST for action security_group_members [ 847.283386] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.283513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.499259] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.780806] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aeca67d3-cefd-4bbb-886d-68b41684f702 [ 847.782037] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.782037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.782037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.782037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.782037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.782037] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aeca67d3-cefd-4bbb-886d-68b41684f702 already deleted. [ 847.782037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aeca67d3-cefd-4bbb-886d-68b41684f702" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.847032] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 in Status: SUCCESS [ 847.847032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.848575] env[69238]: INFO networking_nsxv3.common.synchronization [req-cbd1876b-a328-4dde-a335-7c1d6d9eeb6c req-fd4b3b2c-ef0d-4a7a-8a0d-5e8e8cf4c673 service nova] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 847.848815] env[69238]: INFO networking_nsxv3.common.synchronization [req-cbd1876b-a328-4dde-a335-7c1d6d9eeb6c req-fd4b3b2c-ef0d-4a7a-8a0d-5e8e8cf4c673 service nova] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 847.848977] env[69238]: INFO networking_nsxv3.common.synchronization [req-cbd1876b-a328-4dde-a335-7c1d6d9eeb6c req-fd4b3b2c-ef0d-4a7a-8a0d-5e8e8cf4c673 service nova] Enqueued Resource ID: fff5175b-f505-4219-9ee6-3f473b395874 with Priority: HIGHEST for action port [ 847.849802] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 847.850695] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 847.850858] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff5175b-f505-4219-9ee6-3f473b395874 with Priority: HIGHEST for action port [ 847.851310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.851490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.851568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.851823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.851923] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.853221] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.853769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.853769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.853769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.853908] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.853957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.854067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.854234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.854350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.854448] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.855805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-fff5175b-f505-4219-9ee6-3f473b395874 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.855934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.856085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.857958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.857958] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff5175b-f505-4219-9ee6-3f473b395874',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.002668] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.358882] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.358882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.358882] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.360410] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fff5175b-f505-4219-9ee6-3f473b395874 with status ACTIVE [ 848.360410] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.360410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.360410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.360410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.364145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.364489] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.365987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.366147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.366329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.366586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.366818] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.366954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.367030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.367192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.367590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.367590] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fff5175b-f505-4219-9ee6-3f473b395874 is going to be updated. [ 848.396719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.397376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.397376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.397376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.397376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.398766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fff5175b-f505-4219-9ee6-3f473b395874" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.414593] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: SUCCESS [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.414593] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.414593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.414593] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.509300] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ba02684-f5d9-4b12-92e3-bd740d3677cc req-6775a081-1a07-46c7-88e8-017d90c8f660 tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 848.510987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.511162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.511311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.514111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.514111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.514111] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be updated. [ 848.514111] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 848.514111] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.514111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.514111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.514111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.514111] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.514111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.514111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.518998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.518998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.518998] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.561418] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.561667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.561728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.562031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.562578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.579041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 848.870228] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.926321] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.017538] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.017977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.018125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.018370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.018409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.018634] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.020800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.020800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.020800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.020800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.020800] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 849.053434] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.053595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.053675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.053937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.054097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.066561] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 849.143795] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d84f347-c5bd-4943-8736-772c25927665 in Status: SUCCESS [ 849.144052] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d84f347-c5bd-4943-8736-772c25927665 deletion is rescheduled due to dependency. [ 849.144209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.375925] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.376600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.376600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.376600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.376600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.377136] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be created. [ 849.402944] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.403190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.403389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.404139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.404445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.416831] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: UNINITIALIZED for 2s [ 849.431868] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e23d3814-f79b-4992-979c-27687860c2ee: rpc.has_security_group_logging(os_id): False [ 849.460025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.460025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.460025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.460025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23d3814-f79b-4992-979c-27687860c2ee is going to be created. [ 849.533183] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.533183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.533183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.533183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.533183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.545742] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: IN_PROGRESS for 2s [ 849.871292] env[69238]: INFO networking_nsxv3.common.synchronization [req-9b9ac28d-9367-4836-aac6-b86915cd5cd9 req-1f8cab56-997f-45ab-a1a8-3d87edaaa2f1 tempest-FloatingIPsAssociationTestJSON-1554317950 tempest-FloatingIPsAssociationTestJSON-1554317950-project-member] Enqueued Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 849.871856] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc with Priority: HIGHEST for action security_group_members [ 849.872170] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.872390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.872390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.872545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.872719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.873398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.873398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.876331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.876420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.877051] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bf1f1-444a-46b5-b4a0-baa2f52159cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.927937] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.927937] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.927937] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.928618] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.929065] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.929610] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.929847] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.930203] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.930597] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.932397] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.932397] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.932397] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.932397] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.932397] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.932397] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.932397] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.954842] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.955037] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.955180] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.955350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.957809] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-8d4533dc-fa3a-4b94-a060-d66d7e44437b taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.958140] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.958217] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.958569] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.958815] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d4533dc-fa3a-4b94-a060-d66d7e44437b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.200391] env[69238]: INFO networking_nsxv3.common.synchronization [None req-da9a26ec-e286-484b-8a5b-71548ce0eed7 None None] Enqueued Resource ID: 3ba3121c-958a-4de7-9cec-57db535d806e with Priority: HIGHEST for action port [ 850.200391] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba3121c-958a-4de7-9cec-57db535d806e with Priority: HIGHEST for action port [ 850.200767] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ba3121c-958a-4de7-9cec-57db535d806e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.200767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ba3121c-958a-4de7-9cec-57db535d806e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.200858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ba3121c-958a-4de7-9cec-57db535d806e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.201195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ba3121c-958a-4de7-9cec-57db535d806e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.201247] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba3121c-958a-4de7-9cec-57db535d806e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.378890] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.379069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.379153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.379404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.379504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.379721] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.379821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.379880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.380089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.380177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.380225] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc is going to be updated. [ 850.418169] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.418370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.418471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.418765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.419260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.430185] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: IN_PROGRESS for 2s [ 850.461591] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.461831] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.461954] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.462298] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.462449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.462604] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 8d4533dc-fa3a-4b94-a060-d66d7e44437b not found, creating... [ 850.462879] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.463043] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.463157] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.463379] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.463510] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.463791] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.463939] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.465053] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.465338] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.465477] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.465623] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 8d4533dc-fa3a-4b94-a060-d66d7e44437b is going to be created. [ 850.515281] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.515519] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.516799] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.517589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.517589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.517832] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.597597] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 850.597776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.598127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.598439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.599382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.599779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.599929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.600056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.600239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.600329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.600464] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.601880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.602116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.602309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.603150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.603150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.603150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.603150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.603297] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.704285] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ba3121c-958a-4de7-9cec-57db535d806e [ 850.704511] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.704625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.704757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.705478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.705478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.705607] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ba3121c-958a-4de7-9cec-57db535d806e already deleted. [ 850.705668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ba3121c-958a-4de7-9cec-57db535d806e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.846268] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0a5aa3e5-e2c6-4612-ac6e-a1877201341e None None] Enqueued Resource ID: 06c7c1f4-1a15-4e93-aa10-082f815790ed with Priority: HIGHEST for action port [ 850.846594] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c7c1f4-1a15-4e93-aa10-082f815790ed with Priority: HIGHEST for action port [ 850.847223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-06c7c1f4-1a15-4e93-aa10-082f815790ed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.847693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06c7c1f4-1a15-4e93-aa10-082f815790ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.847790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06c7c1f4-1a15-4e93-aa10-082f815790ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.849853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06c7c1f4-1a15-4e93-aa10-082f815790ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.849949] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06c7c1f4-1a15-4e93-aa10-082f815790ed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.076957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 851.077380] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 deletion is rescheduled due to dependency. [ 851.077380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.106269] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.110082] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.110217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.110357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.110739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.110739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.110811] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.110907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.110964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.111294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.111582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.111582] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be updated. [ 851.159892] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.160045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.160116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.160728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.160728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.169634] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 851.355624] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06c7c1f4-1a15-4e93-aa10-082f815790ed [ 851.356073] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.356073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.356247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.356660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.356660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.357124] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06c7c1f4-1a15-4e93-aa10-082f815790ed already deleted. [ 851.357207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06c7c1f4-1a15-4e93-aa10-082f815790ed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.432028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.432028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.432028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.432028] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.563276] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: SUCCESS [ 851.563276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.609934] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af5e1a5e-9272-4c94-94cf-f661ba1cc217: rpc.has_security_group_logging(os_id): False [ 851.637547] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.637716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.637762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.638126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.638126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.638614] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.638614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.638614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.638899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.638994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.639143] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be updated. [ 851.704105] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.704497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.704817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.704817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.704973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.720795] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: IN_PROGRESS for 2s [ 851.913090] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ba02684-f5d9-4b12-92e3-bd740d3677cc req-5d74f430-1092-4db6-ad7b-d5490651620c service nova] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_rules [ 851.913365] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ba02684-f5d9-4b12-92e3-bd740d3677cc req-5d74f430-1092-4db6-ad7b-d5490651620c service nova] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 851.913676] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ba02684-f5d9-4b12-92e3-bd740d3677cc req-5d74f430-1092-4db6-ad7b-d5490651620c service nova] Enqueued Resource ID: 8d4533dc-fa3a-4b94-a060-d66d7e44437b with Priority: HIGHEST for action port [ 851.914488] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_rules [ 851.914634] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 851.914743] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4533dc-fa3a-4b94-a060-d66d7e44437b with Priority: HIGHEST for action port [ 851.915035] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.915154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.915212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.915405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.915482] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.916460] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.916561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.916561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.917155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.917155] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.917155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.917155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.917489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.917578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.917678] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.918558] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d4533dc-fa3a-4b94-a060-d66d7e44437b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.918558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.919698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.919698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.919698] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d4533dc-fa3a-4b94-a060-d66d7e44437b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.937441] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.420985] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.422441] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.422588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.422734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d4533dc-fa3a-4b94-a060-d66d7e44437b with status ACTIVE [ 852.422921] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.423072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.423144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.423344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.423438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.423610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.423708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.423771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.423917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.423995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.426311] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.426599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.426880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.426880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.427144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.427144] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d4533dc-fa3a-4b94-a060-d66d7e44437b is going to be updated. [ 852.441820] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f87108-657a-479d-b25c-126bec380d7f: rpc.has_security_group_logging(os_id): False [ 852.447970] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc in Status: SUCCESS [ 852.447970] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bf1f1-444a-46b5-b4a0-baa2f52159cc deletion is rescheduled due to dependency. [ 852.447970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bf1f1-444a-46b5-b4a0-baa2f52159cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.465082] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.465082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.465082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.465082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.465082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.465082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d4533dc-fa3a-4b94-a060-d66d7e44437b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.473380] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.473451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.473482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.473819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.473819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.473984] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.474100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.474164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.475061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.475061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.475061] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be created. [ 852.537128] env[69238]: INFO networking_nsxv3.common.synchronization [None req-efeabb02-9135-4215-924c-87018c30cb3d None None] Enqueued Resource ID: f7a39139-c952-469c-a7e0-88420acb5b58 with Priority: HIGHEST for action port [ 852.537892] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a39139-c952-469c-a7e0-88420acb5b58 with Priority: HIGHEST for action port [ 852.538269] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a39139-c952-469c-a7e0-88420acb5b58 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.538400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a39139-c952-469c-a7e0-88420acb5b58" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.538464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a39139-c952-469c-a7e0-88420acb5b58" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.538756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a39139-c952-469c-a7e0-88420acb5b58" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.538876] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a39139-c952-469c-a7e0-88420acb5b58',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.563564] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.563798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.563912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.564230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.564602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.582301] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 852.930979] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.041431] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7a39139-c952-469c-a7e0-88420acb5b58 [ 853.041689] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.041859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.041932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.042734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.042734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.042734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7a39139-c952-469c-a7e0-88420acb5b58 already deleted. [ 853.042734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a39139-c952-469c-a7e0-88420acb5b58" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.180152] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 853.180152] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 deletion is rescheduled due to dependency. [ 853.180152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.433580] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.434018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.434018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.434018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.434201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.434248] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 853.467207] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.467207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.467207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.468571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.468571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.480203] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 853.740964] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 in Status: SUCCESS [ 853.740964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.888393] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9db3056d-3c39-4450-8d7e-97260027ae6f None None] Enqueued Resource ID: 462556df-70bf-4c0b-9adb-61c60ad87cd4 with Priority: HIGHEST for action port [ 853.888970] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462556df-70bf-4c0b-9adb-61c60ad87cd4 with Priority: HIGHEST for action port [ 853.889344] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-462556df-70bf-4c0b-9adb-61c60ad87cd4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.889470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-462556df-70bf-4c0b-9adb-61c60ad87cd4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.889590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-462556df-70bf-4c0b-9adb-61c60ad87cd4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.889838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-462556df-70bf-4c0b-9adb-61c60ad87cd4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.889931] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('462556df-70bf-4c0b-9adb-61c60ad87cd4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.398134] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 462556df-70bf-4c0b-9adb-61c60ad87cd4 [ 854.398134] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.398465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.398465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.398934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.399062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.399062] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:462556df-70bf-4c0b-9adb-61c60ad87cd4 already deleted. [ 854.399173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-462556df-70bf-4c0b-9adb-61c60ad87cd4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.597760] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 854.598358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.230864] env[69238]: INFO networking_nsxv3.common.synchronization [req-deb7af22-84f3-4ae4-a50f-e4c684cf3532 req-920da5b5-dcaa-4dae-8389-074efff012db tempest-SecurityGroupRulesNegativeTestJSON-575417265 tempest-SecurityGroupRulesNegativeTestJSON-575417265-project-member] Enqueued Resource ID: 19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc with Priority: HIGHEST for action security_group_rules [ 855.231993] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc with Priority: HIGHEST for action security_group_rules [ 855.236733] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.236948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.237061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.237358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.237460] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.494036] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 855.494036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.494036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.494036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.494036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.494611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.494611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.494611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.494611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.494768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.494768] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.762869] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.763830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.763933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.764336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.764645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.764742] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc already deleted. [ 855.764834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.909486] env[69238]: INFO networking_nsxv3.common.synchronization [None req-80371579-1214-48d3-b1c8-7b58a2ef179d None None] Enqueued Resource ID: 6917087b-4ee3-4007-bf7c-fdcbb2264d27 with Priority: HIGHEST for action port [ 855.910157] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6917087b-4ee3-4007-bf7c-fdcbb2264d27 with Priority: HIGHEST for action port [ 855.910720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6917087b-4ee3-4007-bf7c-fdcbb2264d27 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.911232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6917087b-4ee3-4007-bf7c-fdcbb2264d27" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.911232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6917087b-4ee3-4007-bf7c-fdcbb2264d27" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.911835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6917087b-4ee3-4007-bf7c-fdcbb2264d27" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.911970] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6917087b-4ee3-4007-bf7c-fdcbb2264d27',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.000412] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.001020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.001020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.001020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.001226] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.001379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.001447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.001610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.001701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.001788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.001939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.002043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.002111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.002325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.002397] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.002544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.002544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.003459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.003459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.003459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.003459] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.414874] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6917087b-4ee3-4007-bf7c-fdcbb2264d27 [ 856.414874] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.415124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.415124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.415195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.415336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.415390] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6917087b-4ee3-4007-bf7c-fdcbb2264d27 already deleted. [ 856.415448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6917087b-4ee3-4007-bf7c-fdcbb2264d27" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.506647] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2: rpc.has_security_group_logging(os_id): False [ 856.531254] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.531254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.531254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.531254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.531254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.531502] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.531502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.532839] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.532839] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.532839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.533288] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 856.547519] env[69238]: INFO networking_nsxv3.common.synchronization [req-0ffa387f-2e01-4c99-90d1-b1034f7475b7 req-baf28e79-4577-4281-bcbf-20a33bd2c94a tempest-SecurityGroupRulesNegativeTestJSON-575417265 tempest-SecurityGroupRulesNegativeTestJSON-575417265-project-member] Enqueued Resource ID: 19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc with Priority: HIGHEST for action security_group_rules [ 856.547519] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc with Priority: HIGHEST for action security_group_rules [ 856.547519] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.547519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.547519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.547519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.547519] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.629771] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.630083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.630198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.631271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.631543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.649969] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 857.075885] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.076149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.076149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.076402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.076580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.076721] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc already deleted. [ 857.076821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c1ebd0-d00e-4dc0-bf46-8b1e969edbbc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.595100] env[69238]: INFO networking_nsxv3.common.synchronization [None req-7af6c6dc-75e0-4a99-a4b9-b2ef113613b6 None None] Enqueued Resource ID: 197a7066-d7c2-48f9-bbef-7d2555f4e950 with Priority: HIGHEST for action port [ 858.595565] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 197a7066-d7c2-48f9-bbef-7d2555f4e950 with Priority: HIGHEST for action port [ 858.596066] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-197a7066-d7c2-48f9-bbef-7d2555f4e950 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.596218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-197a7066-d7c2-48f9-bbef-7d2555f4e950" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.596218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-197a7066-d7c2-48f9-bbef-7d2555f4e950" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.596556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-197a7066-d7c2-48f9-bbef-7d2555f4e950" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.596734] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('197a7066-d7c2-48f9-bbef-7d2555f4e950',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.669013] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 858.669013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.103500] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 197a7066-d7c2-48f9-bbef-7d2555f4e950 [ 859.103500] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.103500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.103500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.103500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.103500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.103500] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:197a7066-d7c2-48f9-bbef-7d2555f4e950 already deleted. [ 859.103500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-197a7066-d7c2-48f9-bbef-7d2555f4e950" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.379871] env[69238]: INFO networking_nsxv3.common.synchronization [None req-7731e1d3-c952-44f3-b8b3-766b6572d8aa None None] Enqueued Resource ID: fb6e2783-69a9-488a-88c6-a25a6e8c6114 with Priority: HIGHEST for action port [ 861.380760] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6e2783-69a9-488a-88c6-a25a6e8c6114 with Priority: HIGHEST for action port [ 861.381278] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6e2783-69a9-488a-88c6-a25a6e8c6114 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.381508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6e2783-69a9-488a-88c6-a25a6e8c6114" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.381638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6e2783-69a9-488a-88c6-a25a6e8c6114" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.382016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6e2783-69a9-488a-88c6-a25a6e8c6114" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.382163] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6e2783-69a9-488a-88c6-a25a6e8c6114',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.884932] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb6e2783-69a9-488a-88c6-a25a6e8c6114 [ 861.885401] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.885401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.885401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.885682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.885812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.885917] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb6e2783-69a9-488a-88c6-a25a6e8c6114 already deleted. [ 861.885999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6e2783-69a9-488a-88c6-a25a6e8c6114" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.631684] env[69238]: INFO networking_nsxv3.common.synchronization [req-3dff10ad-190b-4c4a-9b35-d0e4971c432f req-9eb382a8-d6cb-46f3-b434-bf323a7d42cc tempest-ListImageFiltersTestJSON-266287970 tempest-ListImageFiltersTestJSON-266287970-project-member] Enqueued Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 863.632713] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee600fe-2d5e-4376-8f72-81cf57665aed with Priority: HIGHEST for action security_group_members [ 863.635263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-aee600fe-2d5e-4376-8f72-81cf57665aed taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.635263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.635263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.635263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.635263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.635263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.635263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.635263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.635263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.636021] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aee600fe-2d5e-4376-8f72-81cf57665aed',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.140020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.140020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.140020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.140697] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed is going to be updated. [ 864.180412] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.180412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.180412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.180412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.180592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.195224] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: IN_PROGRESS for 2s [ 864.480908] env[69238]: INFO networking_nsxv3.common.synchronization [req-329daa95-0673-40cd-bd3d-e1f337989ae5 req-ab7cf67d-9fb9-44ec-acaa-969be73fc5ea tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 864.481437] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 864.481997] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.481997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.481997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.482445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.482612] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.483653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.483744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.483920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.484032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.484135] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.711761] env[69238]: INFO networking_nsxv3.common.synchronization [req-67142250-ba03-48c2-8ffc-5de891dd6949 req-616f03d0-8c33-4ef1-9e6f-d08c2dde7ce8 tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 864.712551] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 864.713201] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.713304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.713351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.713938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.713938] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.713938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.714120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.714214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.714332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.714459] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.989622] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.991421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.991421] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d already deleted. [ 864.991421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.200938] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.200938] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.200938] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.200938] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.200938] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.201314] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.201314] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.201451] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.201537] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.201811] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.201887] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.202754] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.202754] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.202754] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.202754] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.202754] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.218064] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.218264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.218354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.218614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.218727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.218986] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.219153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.219216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.219404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.219584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.219673] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 865.223503] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.223693] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.223861] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.224078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.224507] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.224728] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.224863] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.225172] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.225307] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.266946] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.269036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.269224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.270181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.270181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.284343] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 865.727462] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.728026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.728026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.728149] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.728306] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.728468] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 not found, creating... [ 865.728750] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.728968] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.729161] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.729437] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.729589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.730019] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.730213] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.730335] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.730561] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.730702] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.730852] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 is going to be created. [ 865.752380] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.752612] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.752711] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.753017] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.753283] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.753522] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.207669] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aee600fe-2d5e-4376-8f72-81cf57665aed in Status: SUCCESS [ 866.208810] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aee600fe-2d5e-4376-8f72-81cf57665aed deletion is rescheduled due to dependency. [ 866.208810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aee600fe-2d5e-4376-8f72-81cf57665aed" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.685405] env[69238]: INFO networking_nsxv3.common.synchronization [req-329daa95-0673-40cd-bd3d-e1f337989ae5 req-96e8988e-4378-4fff-b9fd-1f609ef3948d service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 866.685598] env[69238]: INFO networking_nsxv3.common.synchronization [req-329daa95-0673-40cd-bd3d-e1f337989ae5 req-96e8988e-4378-4fff-b9fd-1f609ef3948d service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 866.685761] env[69238]: INFO networking_nsxv3.common.synchronization [req-329daa95-0673-40cd-bd3d-e1f337989ae5 req-96e8988e-4378-4fff-b9fd-1f609ef3948d service nova] Enqueued Resource ID: ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 with Priority: HIGHEST for action port [ 866.685989] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 866.686135] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 866.686236] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 with Priority: HIGHEST for action port [ 866.686814] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.686935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.687010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.691228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.691228] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.691228] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.691228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.691228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.691228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.691228] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.691492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.691492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.691492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.691589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.691624] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.692406] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.692524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.692568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.692981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.693080] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.830831] env[69238]: INFO networking_nsxv3.common.synchronization [req-9a1d8cda-3894-45e4-81db-7aff5bdef0c9 req-86793280-9926-4d37-aa8c-a6cb7fd875cc tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 866.831301] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 866.831596] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.831716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.831842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.832052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.832211] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.832350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.832434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.832594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.832680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.832771] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.130620] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.130875] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.131038] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.131385] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.131706] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.131903] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.132053] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.132337] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.132517] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.132759] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.132915] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.133068] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.133206] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.133402] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.133598] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.133771] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.153732] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.153931] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.154078] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.154277] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.154635] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.154935] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.155044] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.155370] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.155518] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c51a5f6-e8ee-4f92-ab3a-980091fe11e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.195293] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.195441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.195631] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.196608] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 with status ACTIVE [ 867.196899] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.197084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.197241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.197495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.197594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.197784] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.197899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.198089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.198166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.198250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.198443] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.198541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.198602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.198763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.198862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.198948] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3 is going to be updated. [ 867.224554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.224554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.224554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.224554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.224554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.224554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff389c24-b7ba-4f0e-a5d0-fcf86a7028b3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.293939] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 867.294236] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 deletion is rescheduled due to dependency. [ 867.294303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.335168] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.335391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.335391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.335586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.335726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.335903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.336135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.336135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.336313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.336313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.336410] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e already deleted. [ 867.336521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.658265] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.658588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.658588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.658893] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.659075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.659588] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 not found, creating... [ 867.659588] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.659743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.659743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.660033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.660118] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.660402] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.660571] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.660690] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.660902] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.661103] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.661259] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 is going to be created. [ 867.690544] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.691063] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.691063] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.691201] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.691402] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.691895] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.702362] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.204119] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.204451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.204451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.204648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.204935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.205109] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be created. [ 868.230610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.230764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.230835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.231445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.231445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.242367] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: UNINITIALIZED for 2s [ 868.382413] env[69238]: INFO networking_nsxv3.common.synchronization [req-9a1d8cda-3894-45e4-81db-7aff5bdef0c9 req-b6588caa-9341-45f5-94cd-22bfb036fa49 service nova] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_rules [ 868.382413] env[69238]: INFO networking_nsxv3.common.synchronization [req-9a1d8cda-3894-45e4-81db-7aff5bdef0c9 req-b6588caa-9341-45f5-94cd-22bfb036fa49 service nova] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 868.382413] env[69238]: INFO networking_nsxv3.common.synchronization [req-9a1d8cda-3894-45e4-81db-7aff5bdef0c9 req-b6588caa-9341-45f5-94cd-22bfb036fa49 service nova] Enqueued Resource ID: 4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 with Priority: HIGHEST for action port [ 868.382413] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_rules [ 868.382675] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 868.382675] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 with Priority: HIGHEST for action port [ 868.384863] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.384982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.385085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.385353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.385432] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.386261] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.386367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.386430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.386592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.386873] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.386933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.386972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.387112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.387200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.387292] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.388383] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.388383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.388383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.388383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.388585] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c51a5f6-e8ee-4f92-ab3a-980091fe11e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.889908] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.890910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.891028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.891198] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 with status ACTIVE [ 868.891356] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.891459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.891523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.891829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.891829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.891953] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.892081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.892121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.892317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.892350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.892504] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.892598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.892654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.892793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.892870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.893179] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c51a5f6-e8ee-4f92-ab3a-980091fe11e8 is going to be updated. [ 868.922438] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.922438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.922438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.922438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.922803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.922861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c51a5f6-e8ee-4f92-ab3a-980091fe11e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.318578] env[69238]: INFO networking_nsxv3.common.synchronization [req-9f2ea0e0-feaa-4e04-924e-7349b367ad88 req-c4398ec2-280c-42c8-8dd4-9c001534cd38 tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 869.319158] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 869.319462] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.319647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.319647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.320109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.320109] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.320355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.320424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.320580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.320667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.320762] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.395929] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.780246] env[69238]: INFO networking_nsxv3.common.synchronization [req-b87887b0-c326-49ba-889b-682f774afd0c req-ceb3bf3a-2b71-480d-96b1-6fbe5796f898 tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 869.780783] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 869.781095] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.781193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.824097] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.899011] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.899011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.899011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.899011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.899011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.899011] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be created. [ 869.925271] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.925490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.925490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.925675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.925834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.938583] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: UNINITIALIZED for 2s [ 870.256631] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 870.256934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.257124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.257344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.257712] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.257792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.257853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.258249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.258388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.258579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.258706] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.266486] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.266790] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.266959] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.267236] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.267568] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.267823] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.267957] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.268219] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.268447] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.268741] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.268872] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.268984] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.269108] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.269223] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.269331] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.269468] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.289735] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.289904] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.289987] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.290210] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.290499] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.290742] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.290926] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.291265] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.291399] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af7511f-8c34-4ecd-8a7b-89b5416c0f75',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.327969] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.763929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.763929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.763929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.763929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.763929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.764249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.764249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.764307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.765106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.765106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.765106] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.765106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.765106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.765106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.765106] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.765414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.765503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.765660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.765779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.765887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.765995] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.794249] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.794446] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.794620] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.795162] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.795162] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.795298] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 0af7511f-8c34-4ecd-8a7b-89b5416c0f75 not found, creating... [ 870.795554] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.795914] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.795914] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.796218] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.796383] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.797034] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.797034] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.797034] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.797290] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.797404] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.797548] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 0af7511f-8c34-4ecd-8a7b-89b5416c0f75 is going to be created. [ 870.818659] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.818945] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.819062] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.819742] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.819981] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.820227] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.829785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.829975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.829975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.830205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.830298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.830419] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 870.868558] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.868749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.868792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.868984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.869971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.880876] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 871.268644] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cd8a4c5-7d49-440a-bef6-697272c0d01d: rpc.has_security_group_logging(os_id): False [ 871.291396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.291396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.291396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.291396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.291396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.291608] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.291608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.291681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.291829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.291904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.292101] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.292187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.292245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.292394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.292465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.292659] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.292747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.292805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.292975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.293523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.293622] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be created. [ 871.356382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.356770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.356770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.356905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.357032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.371559] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 871.508494] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 871.508494] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent loop - iteration:1 started [ 871.695699] env[69238]: INFO networking_nsxv3.common.synchronization [req-b87887b0-c326-49ba-889b-682f774afd0c req-8ee245f4-1d8f-4d86-aeba-d37e08684813 service nova] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_rules [ 871.695880] env[69238]: INFO networking_nsxv3.common.synchronization [req-b87887b0-c326-49ba-889b-682f774afd0c req-8ee245f4-1d8f-4d86-aeba-d37e08684813 service nova] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 871.696137] env[69238]: INFO networking_nsxv3.common.synchronization [req-b87887b0-c326-49ba-889b-682f774afd0c req-8ee245f4-1d8f-4d86-aeba-d37e08684813 service nova] Enqueued Resource ID: 0af7511f-8c34-4ecd-8a7b-89b5416c0f75 with Priority: HIGHEST for action port [ 871.696263] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_rules [ 871.696390] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 871.696487] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af7511f-8c34-4ecd-8a7b-89b5416c0f75 with Priority: HIGHEST for action port [ 871.697225] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.697397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.697643] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.697989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.698438] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.702193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.702269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.702525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.702615] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af7511f-8c34-4ecd-8a7b-89b5416c0f75',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.951477] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 871.951827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.952076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.952367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.952649] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.954028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.954028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.954028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.954028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.954028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.954028] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.959413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.959413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.959413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.959413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.959413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.959413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.959413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.959413] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.209299] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0af7511f-8c34-4ecd-8a7b-89b5416c0f75 with status ACTIVE [ 872.209299] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.209299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.209299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.209299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.209299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.209511] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.209511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.209581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.210126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.210126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.210126] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.210126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.210126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.210384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.210384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.210384] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0af7511f-8c34-4ecd-8a7b-89b5416c0f75 is going to be updated. [ 872.235253] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.235402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.235486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.235676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.235814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.235989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0af7511f-8c34-4ecd-8a7b-89b5416c0f75" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.459598] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.459961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.461187] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.892230] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 872.892493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.964744] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.383818] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 873.384059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.472027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.472027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.472027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.472027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.472027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.472027] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be updated. [ 873.501397] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.501397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.501397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.501397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.501397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.512031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 875.527612] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 875.527612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.527612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.527612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.527612] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.527612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.527612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.527612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.527612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.527612] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.031866] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.534063] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.697395] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 876.697654] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 877.036208] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.036384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.036452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.036677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.036776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.036904] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be updated. [ 877.069650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.069797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.069889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.070105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.070258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.080303] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 877.309945] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5768d579-e7fe-4a9b-9bbd-b45f2379e452 tempest-MigrationsAdminTest-400782288 tempest-MigrationsAdminTest-400782288-project-member] Enqueued Resource ID: e7fe8627-585d-464d-9f06-968071b94569 with Priority: HIGHEST for action security_group_rules [ 877.310624] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7fe8627-585d-464d-9f06-968071b94569 with Priority: HIGHEST for action security_group_rules [ 877.310845] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7fe8627-585d-464d-9f06-968071b94569 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.310976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.311070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.311315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.311408] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7fe8627-585d-464d-9f06-968071b94569',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.400587] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d4fe9e1f-aef0-48ae-9b55-bdfd01d5e063 tempest-MigrationsAdminTest-400782288 tempest-MigrationsAdminTest-400782288-project-member] Enqueued Resource ID: e7fe8627-585d-464d-9f06-968071b94569 with Priority: HIGHEST for action security_group_rules [ 877.401797] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7fe8627-585d-464d-9f06-968071b94569 with Priority: HIGHEST for action security_group_rules [ 877.402111] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7fe8627-585d-464d-9f06-968071b94569 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.402210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.838994] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.838994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.838994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.838994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.838994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.838994] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7fe8627-585d-464d-9f06-968071b94569 already deleted. [ 877.838994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.838994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.838994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.838994] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7fe8627-585d-464d-9f06-968071b94569',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.362670] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.362890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.362949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.363148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.363625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.363625] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7fe8627-585d-464d-9f06-968071b94569 already deleted. [ 878.363625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7fe8627-585d-464d-9f06-968071b94569" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.092368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 879.092724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.092931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.093205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.093406] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.093517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.093579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.093742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.093822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.093924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.094116] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.094210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.094268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.094408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.094547] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.094636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.094693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.094825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.094924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.095014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.095377] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.599540] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab364ad-4952-4848-9774-a09b5ae9ee0e: rpc.has_security_group_logging(os_id): False [ 879.630701] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.630951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.630951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.631295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.631451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.631737] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.631890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.631996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.632248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.632445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.632661] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.632817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.632912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.633837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.633974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.634359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.634465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.634465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.634616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.634699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.634806] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be created. [ 879.709450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.709680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.709751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.710230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.710478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.722084] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 880.434220] env[69238]: INFO networking_nsxv3.common.synchronization [req-23189ce7-0757-473c-b323-f453b7440a5f req-637c7c35-681f-401e-bcef-81dac623587f tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 880.434755] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 880.435482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.438250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.438365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.438637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.439036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.439036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.440044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.440044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.440044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.440044] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.943427] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.943427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.943427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.943427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.943427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.943633] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.943633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.943740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.944813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.944813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.944813] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 880.975232] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.975232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.975232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.975232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.975232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.987071] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 881.736186] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 881.736553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.736608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.736805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.739880] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.245403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.245403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.245403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.245403] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.750637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.750637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.750637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.750637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.750637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.751627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.751627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.751627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.751627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.751627] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.996661] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 882.997097] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 deletion is rescheduled due to dependency. [ 882.997097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.253781] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab364ad-4952-4848-9774-a09b5ae9ee0e: rpc.has_security_group_logging(os_id): False [ 883.273328] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.273562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.273681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.274023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.274112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.274382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.274710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.274710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.274837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.274837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.275154] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.275259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.275351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.275498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.275604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.275947] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.276034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.276078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.276213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.276302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.276370] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be updated. [ 883.339139] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.339352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.339498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.339678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.339899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.356359] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 885.373050] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 885.373343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.435899] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 885.436014] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 886.469833] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c618b731-f450-4bd7-a82c-117623e55845 None None] Enqueued Resource ID: 42d30cca-48b2-4466-8cdd-f3ab96d07121 with Priority: HIGHEST for action port [ 886.470239] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d30cca-48b2-4466-8cdd-f3ab96d07121 with Priority: HIGHEST for action port [ 886.471862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-42d30cca-48b2-4466-8cdd-f3ab96d07121 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.471862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42d30cca-48b2-4466-8cdd-f3ab96d07121" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.471862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42d30cca-48b2-4466-8cdd-f3ab96d07121" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.471862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42d30cca-48b2-4466-8cdd-f3ab96d07121" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.471862] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d30cca-48b2-4466-8cdd-f3ab96d07121',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.978251] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42d30cca-48b2-4466-8cdd-f3ab96d07121 [ 886.978251] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.978251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.978251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.978251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.978251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.978251] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42d30cca-48b2-4466-8cdd-f3ab96d07121 already deleted. [ 886.978251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42d30cca-48b2-4466-8cdd-f3ab96d07121" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.419326] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e00215ce-63d1-4822-9553-e66a3d0b19a7 tempest-ServersTestJSON-976768608 tempest-ServersTestJSON-976768608-project-member] Enqueued Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_rules [ 887.419326] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_rules [ 887.419326] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.419326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.419326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.419326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.419326] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.508829] env[69238]: INFO networking_nsxv3.common.synchronization [None req-97421c5d-fb4c-4a75-93d6-1116212b06b8 tempest-ServersTestJSON-976768608 tempest-ServersTestJSON-976768608-project-member] Enqueued Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_rules [ 887.508829] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_rules [ 887.508829] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.509620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.940906] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.941029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.941086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.941338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.941338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.941508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 already deleted. [ 887.941508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.941666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.941797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.941885] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.468171] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.468366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.468435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.468667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.468794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.468861] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 already deleted. [ 888.468945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.883789] env[69238]: INFO networking_nsxv3.common.synchronization [None req-6115c1b6-ac0b-49f3-b822-a64ed235da97 None None] Enqueued Resource ID: 9b30c3f9-ec5b-4306-b43a-aaa6868fece6 with Priority: HIGHEST for action port [ 888.884868] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b30c3f9-ec5b-4306-b43a-aaa6868fece6 with Priority: HIGHEST for action port [ 888.884868] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b30c3f9-ec5b-4306-b43a-aaa6868fece6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.884868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b30c3f9-ec5b-4306-b43a-aaa6868fece6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.885924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b30c3f9-ec5b-4306-b43a-aaa6868fece6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.885924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b30c3f9-ec5b-4306-b43a-aaa6868fece6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.885924] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b30c3f9-ec5b-4306-b43a-aaa6868fece6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.388203] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b30c3f9-ec5b-4306-b43a-aaa6868fece6 [ 889.388455] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.388611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.388701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.388887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.390019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.390019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b30c3f9-ec5b-4306-b43a-aaa6868fece6 already deleted. [ 889.390019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b30c3f9-ec5b-4306-b43a-aaa6868fece6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.413024] env[69238]: INFO networking_nsxv3.common.synchronization [req-67c68f75-7c51-4d62-aa17-af782d0a82b6 req-ba0f3fd6-7e53-4306-ba2e-831193fe21e9 tempest-ServerMetadataTestJSON-1269964747 tempest-ServerMetadataTestJSON-1269964747-project-member] Enqueued Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_members [ 889.413024] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_members [ 889.413024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.413024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.413024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.414024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.414024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.414337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.414409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.414586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.414805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.414805] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.917376] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.917749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.917749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.917825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.917917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.918141] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.918331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.918331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.918512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.918599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.918703] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 already deleted. [ 889.918835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.043263] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-397 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.043495] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-397" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.043664] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-397" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.043991] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-397" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.044363] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.044482] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.044607] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.044865] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.045190] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.045458] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.045458] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.045592] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.045636] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.045819] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.045950] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.046100] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.066505] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.066729] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.066953] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.067403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-397" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.067796] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-a96552d6-042b-4119-b184-b68d38f18d6f taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.067979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.068264] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.068497] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.068696] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a96552d6-042b-4119-b184-b68d38f18d6f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.571063] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.571366] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.571615] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.571883] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.572136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.572373] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port a96552d6-042b-4119-b184-b68d38f18d6f not found, creating... [ 890.572734] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.572952] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.573099] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.573386] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.573577] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.573965] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.574262] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.574416] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.574642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.574828] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.574993] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: a96552d6-042b-4119-b184-b68d38f18d6f is going to be created. [ 890.600115] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.600394] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.600527] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.600852] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.601140] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.601464] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.578578] env[69238]: INFO networking_nsxv3.common.synchronization [req-67c68f75-7c51-4d62-aa17-af782d0a82b6 req-99c7dd4a-d4d0-4912-8bd3-ccb89179b352 service nova] Enqueued Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_rules [ 891.578859] env[69238]: INFO networking_nsxv3.common.synchronization [req-67c68f75-7c51-4d62-aa17-af782d0a82b6 req-99c7dd4a-d4d0-4912-8bd3-ccb89179b352 service nova] Enqueued Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_members [ 891.578905] env[69238]: INFO networking_nsxv3.common.synchronization [req-67c68f75-7c51-4d62-aa17-af782d0a82b6 req-99c7dd4a-d4d0-4912-8bd3-ccb89179b352 service nova] Enqueued Resource ID: a96552d6-042b-4119-b184-b68d38f18d6f with Priority: HIGHEST for action port [ 891.579134] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_rules [ 891.579369] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_members [ 891.579484] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96552d6-042b-4119-b184-b68d38f18d6f with Priority: HIGHEST for action port [ 891.582220] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.582381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.582433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.582704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.582849] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.583758] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.583884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.583992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.584162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.584338] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.584429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.584491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.585770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.586245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.586245] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.591046] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a96552d6-042b-4119-b184-b68d38f18d6f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.591242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.591306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.591511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.591579] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a96552d6-042b-4119-b184-b68d38f18d6f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.766332] env[69238]: INFO networking_nsxv3.common.synchronization [req-07980114-563c-4dd4-b746-bc5f21078aa0 req-620912fe-af70-49fc-812e-7705e9f1c8ac tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 891.766964] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 891.767487] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.767632] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.767698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.767901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.768083] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.768409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.768409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.768510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.768510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.768600] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.849210] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ca87423-95b7-43d5-9aac-34642bb878fb req-207bab10-bc50-40ce-9230-259cba2f60f0 tempest-InstanceActionsNegativeTestJSON-1348475615 tempest-InstanceActionsNegativeTestJSON-1348475615-project-member] Enqueued Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_members [ 891.849210] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_members [ 891.850047] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.850338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.850506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.850842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.851131] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.851375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.851799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.852105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.852318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.852508] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.097026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.097026] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.097026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a96552d6-042b-4119-b184-b68d38f18d6f with status ACTIVE [ 892.097026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.097026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.097026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.097849] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.097849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.097849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.097849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.097849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.098078] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a96552d6-042b-4119-b184-b68d38f18d6f is going to be updated. [ 892.139340] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.139599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.139599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.140054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.140054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.140261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a96552d6-042b-4119-b184-b68d38f18d6f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.171413] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.171625] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-395" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.171745] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-395" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.172083] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-395" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.172337] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.172494] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.172610] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.172823] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.173111] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.173332] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.173456] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.173557] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.173664] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.173773] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.173886] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.174019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.198217] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.198217] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 892.198217] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.198376] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-395" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.199466] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.199466] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.199466] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.199466] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.199466] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4fb384-e2d0-429c-9e3a-8094f92bf9cb',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.275642] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.275642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.275642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.275642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.275642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.275642] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.275642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.276256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.276256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.276256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.276508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 892.319225] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.319446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.319535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.319802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.319984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.332522] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 892.357484] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.357655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.357749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.357951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.358054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.358293] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.358423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.358465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.358637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.358725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.358818] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 already deleted. [ 892.358932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.601070] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.702945] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.703256] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.703333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.703649] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.703865] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.703979] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port da4fb384-e2d0-429c-9e3a-8094f92bf9cb not found, creating... [ 892.704283] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.704442] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.704558] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.704795] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.704933] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.709022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.709022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.709022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.709022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.709022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.709022] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: da4fb384-e2d0-429c-9e3a-8094f92bf9cb is going to be created. [ 892.728567] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.728775] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.728897] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.729231] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.729478] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.729722] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.104653] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.104865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.104936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.105220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.105331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.105462] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 is going to be created. [ 893.134917] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.135221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.135221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.135361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.135529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.146843] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: UNINITIALIZED for 2s [ 893.460333] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ca87423-95b7-43d5-9aac-34642bb878fb req-8ce3be5d-abba-48d4-acee-75b394f4ded6 service nova] Enqueued Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_rules [ 893.460333] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ca87423-95b7-43d5-9aac-34642bb878fb req-8ce3be5d-abba-48d4-acee-75b394f4ded6 service nova] Enqueued Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_members [ 893.460333] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ca87423-95b7-43d5-9aac-34642bb878fb req-8ce3be5d-abba-48d4-acee-75b394f4ded6 service nova] Enqueued Resource ID: da4fb384-e2d0-429c-9e3a-8094f92bf9cb with Priority: HIGHEST for action port [ 893.460774] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_rules [ 893.460919] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_members [ 893.462989] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4fb384-e2d0-429c-9e3a-8094f92bf9cb with Priority: HIGHEST for action port [ 893.463394] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.463529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.463596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.463862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.464113] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.464938] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.465076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.465140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.465311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.465513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.465619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.465685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.466405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.466405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.466405] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.467305] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.467305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.467305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.467483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.467521] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4fb384-e2d0-429c-9e3a-8094f92bf9cb',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.969796] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.970325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.970325] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.971599] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da4fb384-e2d0-429c-9e3a-8094f92bf9cb with status ACTIVE [ 893.971814] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.971956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.972111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.972352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.972457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.972640] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.972753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.972835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.973250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.973335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.973519] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.973822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.973822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.973822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.973936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.974018] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da4fb384-e2d0-429c-9e3a-8094f92bf9cb is going to be updated. [ 893.999974] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.000192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.000236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.000496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.000557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.000718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da4fb384-e2d0-429c-9e3a-8094f92bf9cb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.340921] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 894.341136] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 894.341252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.476053] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.978831] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.979192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.979192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.979351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.979940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.979940] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 is going to be created. [ 895.031768] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.031908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.031985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.032220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.032425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.042530] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: UNINITIALIZED for 2s [ 895.165913] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: SUCCESS [ 895.166172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.166825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.166825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.166825] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.166825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.167072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.167072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.167146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.167247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.167375] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.517792] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-de632258-a5b0-4ee3-bc86-794910787f32 tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 895.518739] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 895.519258] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.519741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.519741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.520089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.520392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.520606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.520755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.521071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.521267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.521474] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.670800] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.670800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.670800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.671044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.671044] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.671156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.671207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.671412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.671508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.671620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.671795] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.671887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.671947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.672127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.672283] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.672406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.672458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.672826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.672826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.672938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.672938] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.885464] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.885561] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.885743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.885993] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.886436] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.886616] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.886734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.887029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.887299] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.887543] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.887650] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.887758] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.887910] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.887960] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.888075] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.888221] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.913416] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.914845] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 895.914845] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.914845] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.914845] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-adb45a95-2735-469d-ac6f-420805dbbf3d taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.914845] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.915668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.915668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.915668] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb45a95-2735-469d-ac6f-420805dbbf3d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.027258] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.027258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.027258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.027258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.027258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.027669] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.027669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.027669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.027812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.027923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.028057] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 896.059688] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.059836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.059903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.060128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.060270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.071883] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 896.175480] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b44601a-ed8b-4adb-9b57-205d438615d6: rpc.has_security_group_logging(os_id): False [ 896.198258] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.198524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.198655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.198922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.199266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.199570] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.199686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.199752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.199932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.200027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.200230] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.200368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.200441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.200521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.200592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.200778] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.200898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.200953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.201111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.201186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.201272] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 is going to be created. [ 896.286895] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.287136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.287136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.287352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.287539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.299593] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: IN_PROGRESS for 2s [ 896.418603] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.418831] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.419064] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.419278] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.419465] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.419702] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port adb45a95-2735-469d-ac6f-420805dbbf3d not found, creating... [ 896.420437] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.420626] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.420748] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.420982] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.421144] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.421436] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.421593] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.421707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.421915] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.422066] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.422238] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: adb45a95-2735-469d-ac6f-420805dbbf3d is going to be created. [ 896.447813] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.448117] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.448314] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.448649] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.449492] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.449734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.057517] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: SUCCESS [ 897.057517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.057929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.057929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.058152] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.058253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.058253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.058436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.058520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.058627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.058715] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.230171] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-1085aa8c-b91a-4b0b-a23f-c9bf027adf31 service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 897.231037] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-1085aa8c-b91a-4b0b-a23f-c9bf027adf31 service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 897.231037] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-1085aa8c-b91a-4b0b-a23f-c9bf027adf31 service nova] Enqueued Resource ID: adb45a95-2735-469d-ac6f-420805dbbf3d with Priority: HIGHEST for action port [ 897.231400] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 897.231400] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 897.231521] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb45a95-2735-469d-ac6f-420805dbbf3d with Priority: HIGHEST for action port [ 897.232388] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.232388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.232388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.232388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.232388] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.234146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.234293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.234456] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-adb45a95-2735-469d-ac6f-420805dbbf3d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.234641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.234641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.234794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.234878] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb45a95-2735-469d-ac6f-420805dbbf3d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.564049] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.564238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.564307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.564530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.564709] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.564816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.564856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.565028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.565142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.565222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.565356] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.565444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.565500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.565647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.565785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.565906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.565984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.566090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.566166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.566249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.566341] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.735643] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.735837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.739349] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adb45a95-2735-469d-ac6f-420805dbbf3d with status ACTIVE [ 897.739718] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.739949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.740142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.740356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.740442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.740722] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.740914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.741040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.741230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.741409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.741609] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.742021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.742021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.743374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.743374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.743374] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adb45a95-2735-469d-ac6f-420805dbbf3d is going to be updated. [ 897.769183] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.769340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.769413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.769720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.769883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.770068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adb45a95-2735-469d-ac6f-420805dbbf3d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.071935] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bd7bcc4-c543-4591-9293-2c04b0aaef21: rpc.has_security_group_logging(os_id): False [ 898.089461] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 898.089733] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe deletion is rescheduled due to dependency. [ 898.089859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.090149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.090275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.090498] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.090617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.090689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.090896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.090962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.091013] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.092744] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.092856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.092928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.093104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.093206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.093386] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.093488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.093705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.093705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.093802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.093945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.094067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.094127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.094270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.094345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.094596] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.094659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.094696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.094839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.094924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.095015] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 is going to be created. [ 898.212822] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-b3d3c6ae-4654-40f0-b627-3a216ad6f2d9 tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 898.213793] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 898.214171] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.214279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.274634] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.274832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.274975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.275269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.275505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.289964] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: IN_PROGRESS for 2s [ 898.319266] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: SUCCESS [ 898.319647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.543183] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.543183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.543183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.543183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.543631] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.544038] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.544459] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.544909] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.545284] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.545634] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.545901] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.546136] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.546353] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.547687] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.547687] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.547687] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.569514] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.570423] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 898.570423] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.570689] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-510" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.572862] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-1a343b35-189f-490c-be68-8ff5f2357094 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.572862] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.572862] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.572862] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.572862] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a343b35-189f-490c-be68-8ff5f2357094',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.598184] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.074798] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.075206] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.075206] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.075516] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.075623] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.075805] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 1a343b35-189f-490c-be68-8ff5f2357094 not found, creating... [ 899.076112] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.076287] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.076409] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.076630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.076769] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.077068] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.077290] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.077431] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.077650] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.077863] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.077948] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 1a343b35-189f-490c-be68-8ff5f2357094 is going to be created. [ 899.100019] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.109755] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.109971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.110065] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.110350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.110595] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.110829] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.292794] env[69238]: INFO networking_nsxv3.common.synchronization [req-3e61d3cb-885e-4394-a142-8acdba5d9cf5 req-2ba86aca-2095-4f73-8c8c-54fa2e89247e tempest-ImagesOneServerTestJSON-560061222 tempest-ImagesOneServerTestJSON-560061222-project-member] Enqueued Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_members [ 899.293362] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGHEST for action security_group_members [ 899.293903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.294045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.294122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.294327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.294538] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.294616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.294656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.294785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.294872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.294962] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.602717] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.604393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.604393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.604393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.604393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.604393] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 899.646563] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.646563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.646563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.646801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.646801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.659990] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 899.798016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.798016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.798275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.798369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.798422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.798828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.798828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.798828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.798950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.799085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.799153] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 is going to be updated. [ 899.839577] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.839746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.839814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.840020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.840174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.850783] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 in Status: IN_PROGRESS for 2s [ 899.858925] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-0a54c79a-ff35-4116-9760-ec7284a9107d service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 899.859957] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-0a54c79a-ff35-4116-9760-ec7284a9107d service nova] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 899.859957] env[69238]: INFO networking_nsxv3.common.synchronization [req-e186a8d3-2e6d-47fd-a390-44c819d104c8 req-0a54c79a-ff35-4116-9760-ec7284a9107d service nova] Enqueued Resource ID: 1a343b35-189f-490c-be68-8ff5f2357094 with Priority: HIGHEST for action port [ 899.859957] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_rules [ 899.859957] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 899.859957] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a343b35-189f-490c-be68-8ff5f2357094 with Priority: HIGHEST for action port [ 899.860327] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.860388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.860600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.860678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.860803] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a343b35-189f-490c-be68-8ff5f2357094 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.860892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.860944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.861518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.861518] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a343b35-189f-490c-be68-8ff5f2357094',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.303620] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: SUCCESS [ 900.303965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.363200] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a343b35-189f-490c-be68-8ff5f2357094 with status ACTIVE [ 900.363200] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.363418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.363418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.364690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.364971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.365371] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.365555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.366117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.366117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.366117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.366691] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.366691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.366691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.366915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.367039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.367166] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a343b35-189f-490c-be68-8ff5f2357094 is going to be updated. [ 900.391322] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.391525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.391525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.391778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.391823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.392071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a343b35-189f-490c-be68-8ff5f2357094" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.924725] env[69238]: INFO networking_nsxv3.common.synchronization [req-281fbe61-54b8-4900-8d91-94d9ffc86ef1 req-fdd77f2e-bec8-4e6c-ac56-a2e200410d75 tempest-ServerAddressesTestJSON-1304762753 tempest-ServerAddressesTestJSON-1304762753-project-member] Enqueued Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_members [ 900.925280] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_members [ 900.925575] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.925697] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.925761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.926080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.926261] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.926371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.926418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.926562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.926644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.926737] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.239127] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.239332] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.239457] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.239788] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.240057] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.240218] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.240332] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.240897] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.240897] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.240897] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.241100] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.241100] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.241193] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.241286] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.241388] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.241527] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.261191] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.261371] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.261511] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.261687] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.262009] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-fe353e01-a326-4d7b-b12c-793add64937c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.262186] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.262345] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.262632] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.262803] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe353e01-a326-4d7b-b12c-793add64937c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.432588] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.433239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.433571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.433858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.434060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.434355] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.434566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.434723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.434953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.435123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.435350] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad already deleted. [ 901.435592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.442396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.442396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.442396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.442396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.442396] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.672061] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.672061] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.672061] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.672061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.672061] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.673366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.673766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.674527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.674640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.674753] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.764634] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.764884] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.764968] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.765261] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.765673] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.765673] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port fe353e01-a326-4d7b-b12c-793add64937c not found, creating... [ 901.765904] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.766079] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.766199] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.766419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.766581] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.766866] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.767037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.767164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.767432] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.767577] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.767710] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: fe353e01-a326-4d7b-b12c-793add64937c is going to be created. [ 901.792022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.792022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.792022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.792022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.792022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.792022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.863594] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 in Status: SUCCESS [ 901.863594] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 deletion is rescheduled due to dependency. [ 901.863594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.944369] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.177463] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.177463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.177628] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.449334] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.500486] env[69238]: INFO networking_nsxv3.common.synchronization [req-281fbe61-54b8-4900-8d91-94d9ffc86ef1 req-36efff60-f3e0-4453-86e3-29d9ffa35383 service nova] Enqueued Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_rules [ 902.500486] env[69238]: INFO networking_nsxv3.common.synchronization [req-281fbe61-54b8-4900-8d91-94d9ffc86ef1 req-36efff60-f3e0-4453-86e3-29d9ffa35383 service nova] Enqueued Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_members [ 902.500486] env[69238]: INFO networking_nsxv3.common.synchronization [req-281fbe61-54b8-4900-8d91-94d9ffc86ef1 req-36efff60-f3e0-4453-86e3-29d9ffa35383 service nova] Enqueued Resource ID: fe353e01-a326-4d7b-b12c-793add64937c with Priority: HIGHEST for action port [ 902.502277] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_rules [ 902.502277] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_members [ 902.502277] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe353e01-a326-4d7b-b12c-793add64937c with Priority: HIGHEST for action port [ 902.502277] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.502277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.502277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.502277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.502277] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.504490] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.505183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.505277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.505897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.505897] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.506055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.506690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.506690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.506690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.506690] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.507777] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe353e01-a326-4d7b-b12c-793add64937c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.507929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.508111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.508355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.508444] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe353e01-a326-4d7b-b12c-793add64937c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.679991] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.952180] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 902.952348] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 903.010718] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.010932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.011178] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.012678] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe353e01-a326-4d7b-b12c-793add64937c with status ACTIVE [ 903.012678] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.012937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.012937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.013177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.013279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.013530] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.013675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.013771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.014097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.014159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.014436] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.014578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.014643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.014988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.014988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.014988] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe353e01-a326-4d7b-b12c-793add64937c is going to be updated. [ 903.038929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.039124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.039205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.039495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.039723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.039915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe353e01-a326-4d7b-b12c-793add64937c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.182193] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.182368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.182681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.182757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.182831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.182930] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 903.220516] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.220668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.220721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.220943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.221135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.230215] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 903.517493] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.812021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.812021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.812021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.812021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.832152] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 903.834080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.834237] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 903.862010] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.862173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.862293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.862445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.870175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.871095] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 903.871095] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 903.871095] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 903.909423] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.909635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.909777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.909991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.911292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.911471] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 903.946437] env[69238]: INFO networking_nsxv3.common.synchronization [req-5a9858e4-edd0-4240-89ba-eebf1664b85f req-3ddbbf1f-700f-4d7c-bc57-7f040f756e70 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 903.947031] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 903.947382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.947538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.947605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.947885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.948094] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.948197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.948261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.948418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.948598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.948661] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.970194] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.971111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.971159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.971405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.971650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.971886] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 904.020048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.020252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.020365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.020685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.020800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.020957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad is going to be created. [ 904.048637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.048809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.048874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.049117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.049284] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.052991] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.053185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.053185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.053374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.053601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.053857] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 904.053950] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0e0ac3f6-a8a3-4493-abbd-ec93cceade61', 'd3f87108-657a-479d-b25c-126bec380d7f', '8d84f347-c5bd-4943-8736-772c25927665', '8b44d3fc-7a43-4b31-850f-15e701b8ab7c', '8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7', 'c5c36918-1cb3-48fc-9bfd-8e61ee964b49', '161eb351-451d-49f3-803f-374b4ae2741c', '8bd7bcc4-c543-4591-9293-2c04b0aaef21', '17abedf8-39e0-48a5-82ba-2806c6053ebe', 'fdc2f887-03c1-42e5-b9e7-cefa5083fdea', '1ab364ad-4952-4848-9774-a09b5ae9ee0e', 'e23d3814-f79b-4992-979c-27687860c2ee', 'fd8c2d89-8008-4f6a-97b2-32f45c842cdf', '7001fc5d-d888-45cf-bc02-9dae4d3e3335', '18ed08a2-cdfd-4978-a1e0-e54baa6accdf', '3b44601a-ed8b-4adb-9b57-205d438615d6', 'e0a6d09e-93ad-4f0a-b077-df666e70f18f', '1e2d26f8-cf66-400c-8b21-810887d32724', '9289966e-1f55-477f-8d5c-d3d5fe95527c', '01854ee2-08ca-46e9-8724-734e384f01a4', 'af5e1a5e-9272-4c94-94cf-f661ba1cc217', '1e00b7de-bd62-4244-a65e-9ce263afed97', 'e3efc2ce-5009-447c-a310-4d3178a7395c', '69fbfff4-4d12-49da-9085-7d562819c005', 'aee600fe-2d5e-4376-8f72-81cf57665aed', '152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6', '4b1eab02-6277-4c21-b07d-5b4f5b13a3f2', 'c9df4a22-2e58-46f6-9dc8-bffb28401a54', 'b6b0ebb8-e601-44fa-aac4-0c8f25377737', 'ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd', '1190c58c-c48e-453c-afe1-9063beda849a', '1cd8a4c5-7d49-440a-bef6-697272c0d01d', 'aa4bf1f1-444a-46b5-b4a0-baa2f52159cc', 'a6bd121c-8d73-451b-96a4-3bfa5fbaad57', '9501cdef-a5a1-4d58-9c4f-32f41304e816'} {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 904.054047] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 904.068276] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad in Status: UNINITIALIZED for 2s [ 904.081936] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.082164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.082164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.082356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.082641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.082641] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 904.082641] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 904.082844] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 904.158094] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.158298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.158600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.158778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.159529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.159798] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 904.159903] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 904.159968] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 904.160065] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 904.160551] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 904.160647] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGH for action security_group_rules [ 904.160706] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGH for action security_group_rules [ 904.162683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.284611] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.284792] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.284924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.285249] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.285511] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.285767] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.285767] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.285980] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.286342] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.286561] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.286672] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.286778] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.286882] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.286990] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.287106] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.287240] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.308447] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.309495] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.309495] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.309495] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.311301] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-5be6e541-a0f9-4e65-a912-012984f1c608 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.311301] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.311301] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.311301] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.311301] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5be6e541-a0f9-4e65-a912-012984f1c608',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.452702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.452927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.453030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.453190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.453296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.453490] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.453582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.453638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.453791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.453866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.453952] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be already deleted. [ 904.454053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.816753] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.816753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.816753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.817207] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.817207] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.817207] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 5be6e541-a0f9-4e65-a912-012984f1c608 not found, creating... [ 904.817479] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.817676] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.817854] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.818147] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.818346] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.818686] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.818853] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.818970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.819193] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.819328] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.819562] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 5be6e541-a0f9-4e65-a912-012984f1c608 is going to be created. [ 904.843254] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.843511] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.843724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.844151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.844405] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.844650] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.242146] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 905.242266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.242457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.242735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.243219] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.243219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.243219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.243435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.243435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.243506] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.567739] env[69238]: INFO networking_nsxv3.common.synchronization [req-5a9858e4-edd0-4240-89ba-eebf1664b85f req-b13ffbc6-1b0f-459f-aab7-235231fa6028 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 905.567956] env[69238]: INFO networking_nsxv3.common.synchronization [req-5a9858e4-edd0-4240-89ba-eebf1664b85f req-b13ffbc6-1b0f-459f-aab7-235231fa6028 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 905.568460] env[69238]: INFO networking_nsxv3.common.synchronization [req-5a9858e4-edd0-4240-89ba-eebf1664b85f req-b13ffbc6-1b0f-459f-aab7-235231fa6028 service nova] Enqueued Resource ID: 5be6e541-a0f9-4e65-a912-012984f1c608 with Priority: HIGHEST for action port [ 905.568708] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 905.568856] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 905.568982] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be6e541-a0f9-4e65-a912-012984f1c608 with Priority: HIGHEST for action port [ 905.569213] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 with Priority: HIGH for action security_group_rules [ 905.569349] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d84f347-c5bd-4943-8736-772c25927665 with Priority: HIGH for action security_group_rules [ 905.569873] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGH for action security_group_rules [ 905.569873] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGH for action security_group_rules [ 905.569873] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01854ee2-08ca-46e9-8724-734e384f01a4 with Priority: HIGH for action security_group_rules [ 905.569873] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGH for action security_group_rules [ 905.569873] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2d26f8-cf66-400c-8b21-810887d32724 with Priority: HIGH for action security_group_rules [ 905.569873] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGH for action security_group_rules [ 905.570128] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 with Priority: HIGH for action security_group_rules [ 905.570128] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGH for action security_group_rules [ 905.570196] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf with Priority: HIGH for action security_group_rules [ 905.570285] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGH for action security_group_rules [ 905.570341] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGH for action security_group_rules [ 905.570427] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea with Priority: HIGH for action security_group_rules [ 905.570543] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGH for action security_group_rules [ 905.570612] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 with Priority: HIGH for action security_group_rules [ 905.570955] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGH for action security_group_rules [ 905.571116] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 with Priority: HIGH for action security_group_rules [ 905.571169] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGH for action security_group_rules [ 905.572476] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGH for action security_group_rules [ 905.572476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.572476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.572476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.572476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.572476] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.573036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.573036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.573127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.573292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.573395] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.573486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.573540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.573725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.573785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.573843] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.574579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-5be6e541-a0f9-4e65-a912-012984f1c608 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.574704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.574766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.574883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.574954] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5be6e541-a0f9-4e65-a912-012984f1c608',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.576133] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.576133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.576133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.576133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.576133] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e0ac3f6-a8a3-4493-abbd-ec93cceade61',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.576704] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d84f347-c5bd-4943-8736-772c25927665 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.576808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.576864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.577240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.577240] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d84f347-c5bd-4943-8736-772c25927665',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.578307] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.578413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.578499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.578666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.578732] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.579815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.579958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.580127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.580197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.580252] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.581078] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01854ee2-08ca-46e9-8724-734e384f01a4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.581191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.581247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.581372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.581448] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01854ee2-08ca-46e9-8724-734e384f01a4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.582370] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.582549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.582639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.582753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.582852] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.583837] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2d26f8-cf66-400c-8b21-810887d32724 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.583837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.583981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.584040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.584083] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2d26f8-cf66-400c-8b21-810887d32724',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.584314] env[69238]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 905.585198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.585433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.585687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.585801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.586413] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.589352] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.589352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.589352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.590093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.590093] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7001fc5d-d888-45cf-bc02-9dae4d3e3335',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.590550] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.590664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.590728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.590890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.590964] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.591985] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.592153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.592153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.592295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.592604] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd8c2d89-8008-4f6a-97b2-32f45c842cdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.593250] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.593366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.593426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.593567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.593651] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.595656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.595797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.595868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.596097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.596177] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.597125] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.597234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.597234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.597393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.597517] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc2f887-03c1-42e5-b9e7-cefa5083fdea',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.599492] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.599597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.600067] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.600289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.600364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.600705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.600831] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c36918-1cb3-48fc-9bfd-8e61ee964b49',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.602757] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.602757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.602757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.602987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.603070] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.604024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.604137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.604137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.604267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.604334] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.604550] env[69238]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 905.605278] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.605388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.605436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.605576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.605647] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.606655] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.608892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.608892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.608892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.608892] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.619663] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.652305] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.652548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.652548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.652650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.694227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.694487] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e0ac3f6-a8a3-4493-abbd-ec93cceade61 is going to be deleted. [ 905.746031] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.789256] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.789398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.789468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.789682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.789778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.791097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e0ac3f6-a8a3-4493-abbd-ec93cceade61" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.079442] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad in Status: SUCCESS [ 906.079796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.079935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.080181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.080405] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.080490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.080528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.080674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.080755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.080838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.080930] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.110448] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.110618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.110885] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5be6e541-a0f9-4e65-a912-012984f1c608 with status ACTIVE [ 906.110969] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.111096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.111308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.111390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.111495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.111616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.111718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.111768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.111914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.111983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.112417] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.112417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.112417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.112651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.112651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.112651] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5be6e541-a0f9-4e65-a912-012984f1c608 is going to be updated. [ 906.124868] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.134709] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.134927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.135133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.135267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.135456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5be6e541-a0f9-4e65-a912-012984f1c608" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.161808] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.162109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.162109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.163053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.163053] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.163053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.163053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.163053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.163053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.163053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.163053] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.164138] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.164263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.164263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.164438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.164555] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.164657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.164730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.164841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.164939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.166520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.166678] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.168293] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.168293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.168293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.168629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.168709] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.168804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.168872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.168985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.169075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.169152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.171850] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.171850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.171850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.171850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.171850] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.172747] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.172822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.172861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.174275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.174275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.174275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.174275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.174275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.174275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.174275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.174275] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.174704] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.174704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.174704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.174704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.174874] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.174874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.174972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.175781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.175781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.175781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.175781] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.176238] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.176238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.176238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.176238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.177468] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.177468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.177468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.177468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.177468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.177468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.177468] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.179093] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.179093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.179093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.179093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.179093] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.179093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.179093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.179093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.179461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.179461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.179461] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.181936] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.181936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.182084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.182201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.183186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.183186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.183186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.183186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.183186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.183186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.183186] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.194399] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.194570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.194622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.194818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.199354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.199530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.199530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.199747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.199891] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.199985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.200058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.200202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.200288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.200372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.200460] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.230369] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.230618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.230906] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.231012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.232378] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.232505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.240048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.240216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.242972] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.243102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.246531] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.246656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.247927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.248057] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc2f887-03c1-42e5-b9e7-cefa5083fdea is going to be deleted. [ 906.249057] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.249909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.250144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.252277] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.252349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.274464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.274638] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d84f347-c5bd-4943-8736-772c25927665 is going to be deleted. [ 906.275823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.276046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.298395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.298586] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c36918-1cb3-48fc-9bfd-8e61ee964b49 is going to be deleted. [ 906.299556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.299847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.318088] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.318284] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.325843] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.326053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.334096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.334268] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01854ee2-08ca-46e9-8724-734e384f01a4 is going to be deleted. [ 906.335176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.335421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.361664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.361830] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7001fc5d-d888-45cf-bc02-9dae4d3e3335 is going to be deleted. [ 906.362812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.363109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.381425] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.381609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.399046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.399046] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd8c2d89-8008-4f6a-97b2-32f45c842cdf is going to be deleted. [ 906.400133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.400532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.463913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.463913] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7 is going to be deleted. [ 906.465663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.465663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.478285] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.478411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.515572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.515572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.526929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.527080] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2d26f8-cf66-400c-8b21-810887d32724 is going to be deleted. [ 906.528151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.528399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.528505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.528633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc2f887-03c1-42e5-b9e7-cefa5083fdea" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.528799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.528950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.529185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.529730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d84f347-c5bd-4943-8736-772c25927665" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.530197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.530426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.530545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.530722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c36918-1cb3-48fc-9bfd-8e61ee964b49" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.530893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.531143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.531256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.531408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01854ee2-08ca-46e9-8724-734e384f01a4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.532236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.532236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.532236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.532236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd8c2d89-8008-4f6a-97b2-32f45c842cdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.583988] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.584365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.584365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.584489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.584694] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.584858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.584858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.585100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.585184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.585230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.585385] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.585484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.585555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.585710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.585860] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.585959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.586023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.586167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.586243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.586327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.586424] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.588144] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.588327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.588327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.588573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.588641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.588695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7001fc5d-d888-45cf-bc02-9dae4d3e3335" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.616437] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.616597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.616665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.616880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.616980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.617126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c6f7e5c-f4c6-4fc4-9bb6-e859531bd9a7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.627515] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.627747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.627825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.628152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.628304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.628477] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be created. [ 906.670813] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.670813] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.670813] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.670813] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.670813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.671488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.671488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.671488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.671488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.671488] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.689594] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.689838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.689963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.690282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.690552] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.690724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.690850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.691136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.691515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.691515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.691641] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.691779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.691906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.692426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.692426] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.692613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.692649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.693312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.693510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.693616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.693914] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.695645] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.696963] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.699560] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.700570] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.700707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.700751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.701893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.701893] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.701893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.701893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.701893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.701893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.701893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.702521] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.702521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.702521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.702521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.702521] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.702752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.702752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.702752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.703057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.703057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.703057] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.704773] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.705811] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.705963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.706613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.706902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.707136] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.707258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.707336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.708519] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.708519] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.708519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.709172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.709172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.709172] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.709757] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.709882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.709933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.713025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.713025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.713025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.713025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.713025] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.713963] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.740261] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.740520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.740641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.741028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.741343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.752931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.753234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.753379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.753760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.753957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.754178] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 906.791468] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: UNINITIALIZED for 2s [ 906.804432] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.804634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.804739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.805042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.805168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.805346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2d26f8-cf66-400c-8b21-810887d32724" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.837455] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.837892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.837892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.838061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.838200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.850643] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 907.092811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad: rpc.has_security_group_logging(os_id): False [ 907.122476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.122476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.122476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.122762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.122762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.122912] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.123061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.123061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.124303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.124408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.124847] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.124847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.124847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.125125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.125125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.125275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.125647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.125735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.125911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.125996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.126237] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad is going to be created. [ 907.178105] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9289966e-1f55-477f-8d5c-d3d5fe95527c: rpc.has_security_group_logging(os_id): False [ 907.199071] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bd7bcc4-c543-4591-9293-2c04b0aaef21: rpc.has_security_group_logging(os_id): False [ 907.213847] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f87108-657a-479d-b25c-126bec380d7f: rpc.has_security_group_logging(os_id): False [ 907.215031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b44601a-ed8b-4adb-9b57-205d438615d6: rpc.has_security_group_logging(os_id): False [ 907.215916] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0a6d09e-93ad-4f0a-b077-df666e70f18f: rpc.has_security_group_logging(os_id): False [ 907.217291] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18ed08a2-cdfd-4978-a1e0-e54baa6accdf: rpc.has_security_group_logging(os_id): False [ 907.218121] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e23d3814-f79b-4992-979c-27687860c2ee: rpc.has_security_group_logging(os_id): False [ 907.218910] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b44d3fc-7a43-4b31-850f-15e701b8ab7c: rpc.has_security_group_logging(os_id): False [ 907.220229] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab364ad-4952-4848-9774-a09b5ae9ee0e: rpc.has_security_group_logging(os_id): False [ 907.221583] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161eb351-451d-49f3-803f-374b4ae2741c: rpc.has_security_group_logging(os_id): False [ 907.234831] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.234831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.234831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.235148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.235317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.258762] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.258949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.258949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.259157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.261011] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.261187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.262505] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.262505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.262952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.262952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.265712] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.265712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.265712] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad in Status: IN_PROGRESS for 2s [ 907.265712] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.265712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.271504] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.271653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.274136] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.274272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.275096] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.275199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.285094] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.285094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.296600] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 907.297328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.297721] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.297831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.297892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.298147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.298233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.298338] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c is going to be updated. [ 907.299648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.299877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.336204] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.336505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.336505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.336619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.336690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.336906] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.337013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.342190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.342417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.342509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.342768] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.342856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.342914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.343132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.343185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.343277] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be updated. [ 907.344401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.344568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.389898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.390459] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.390677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.390794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.391144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.391319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.391702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.391903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.392300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.392367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.392457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.392828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.392924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.393824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.394170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.394514] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.394582] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 is going to be updated. [ 907.396424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.397141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.429195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.429446] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.429552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.429620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.429839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.429954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.430020] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf is going to be updated. [ 907.431360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.431686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.466137] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.466340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.467191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.467695] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.467695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.467695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.468118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.468225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.468375] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 907.469519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.469913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.485931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.485931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.494898] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5e966d7c-be51-4a34-822d-dfc723227ce2 None None] Enqueued Resource ID: 962cba6a-34dd-447f-bdd8-280ad3accd2b with Priority: HIGHEST for action port [ 907.495603] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 962cba6a-34dd-447f-bdd8-280ad3accd2b with Priority: HIGHEST for action port [ 907.495964] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-962cba6a-34dd-447f-bdd8-280ad3accd2b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.496251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-962cba6a-34dd-447f-bdd8-280ad3accd2b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.496340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-962cba6a-34dd-447f-bdd8-280ad3accd2b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.496669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-962cba6a-34dd-447f-bdd8-280ad3accd2b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.496752] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962cba6a-34dd-447f-bdd8-280ad3accd2b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.517667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.517787] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.517856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.517939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.518938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.518938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.518938] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.518938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.518938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.518938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.519429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.519429] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.519634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.519634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.519699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.519737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.522464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 907.522464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.522464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.542858] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.543145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.558398] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.558660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.564268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.565263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.565263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.565263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.565263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.565263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.565263] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be updated. [ 907.566154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.566321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.620761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.620761] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.620761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.620761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.621545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.621545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.621545] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.621545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.621719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.621892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.621892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.623285] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.623285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.623285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.623285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.623285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.623285] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 is going to be updated. [ 907.631552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.631552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.631552] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.631552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.680095] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.680252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.710545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.711081] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.711256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.711364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.711700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.711897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.712138] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23d3814-f79b-4992-979c-27687860c2ee is going to be updated. [ 907.713789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.714139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.743157] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.743318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.747271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.747608] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.747721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.747790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.748214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.748326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.748533] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.748637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.748691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.748857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.748930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.749132] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.749213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.749274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.749413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.749502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.749597] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be updated. [ 907.751368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.751561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.751712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.754553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.754710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.754850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.755817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.755982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.756126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.756988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.757167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.757292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.759105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.759105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.759105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.760095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.760213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.760341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.761768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.761931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.762493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.778507] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: IN_PROGRESS for 2s [ 907.811689] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: IN_PROGRESS for 2s [ 907.824997] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 907.825923] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 907.826697] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 907.827622] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 907.828641] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.828846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.828919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.829152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.829304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.833327] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: IN_PROGRESS for 2s [ 907.840462] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.840702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.840702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.840893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.841088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.857232] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: IN_PROGRESS for 2s [ 907.859044] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: IN_PROGRESS for 2s [ 907.895131] env[69238]: INFO networking_nsxv3.common.synchronization [req-7ee83c9a-0e83-433a-9bd2-5f85ea1e3125 req-adf1ff4d-7dbc-4526-825f-129202cd0da8 tempest-InstanceActionsNegativeTestJSON-1348475615 tempest-InstanceActionsNegativeTestJSON-1348475615-project-member] Enqueued Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_members [ 907.895811] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGHEST for action security_group_members [ 907.896171] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.896441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.896441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.896583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.896740] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.896841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.896903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.897055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.897184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.897276] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.921933] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.922149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.922149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.922359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.922587] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.953141] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: IN_PROGRESS for 2s [ 907.998956] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 962cba6a-34dd-447f-bdd8-280ad3accd2b [ 907.999205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.999353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.999429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.999660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.999812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.999911] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:962cba6a-34dd-447f-bdd8-280ad3accd2b already deleted. [ 908.000104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-962cba6a-34dd-447f-bdd8-280ad3accd2b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.399910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.400227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.400227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.400954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.400954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.400954] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.400954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.400954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.401215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.401215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.401215] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 is going to be updated. [ 908.433700] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.433839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.433905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.434138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.434267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.447848] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: IN_PROGRESS for 2s [ 908.802567] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 908.802567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.802567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.805052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.805052] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.805052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.805052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.805052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.805052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.805052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.805052] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.862358] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 908.863069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.863069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.863069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.863321] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.863321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.863469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.863531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.863588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.863788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.863869] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.863958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.863958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.864383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.864692] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.864835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.864927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.865115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.865226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.865366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.865488] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.995890] env[69238]: INFO networking_nsxv3.common.synchronization [req-575399a2-684c-4513-bb55-1f11f859752f req-de529912-5441-4938-8d22-5d6ac1f1094d tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 908.996525] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 908.996815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.998597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.999340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.000291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.000291] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.000291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.000291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.000291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.000291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.000291] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.277734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad in Status: SUCCESS [ 909.277964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.296918] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.297164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.297323] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.297705] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.297984] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.298185] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.298309] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.298642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.298799] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.299067] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.299198] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.299333] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.299456] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.299592] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.299733] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.299879] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.307355] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.307530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.307576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.307761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.307919] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.308029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.308089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.308235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.308323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.308425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.308587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.308677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.308736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.308868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.309014] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.309105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.309162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.309296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.309369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.309448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.309537] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.319131] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.319340] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 909.319494] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.319680] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.320028] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4beef149-4a16-4e46-93f5-d170ced68ea1 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.320229] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.320367] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.320750] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.320907] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4beef149-4a16-4e46-93f5-d170ced68ea1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.369435] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17abedf8-39e0-48a5-82ba-2806c6053ebe: rpc.has_security_group_logging(os_id): False [ 909.387440] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.387816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.387816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.387967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.407777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.408153] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.408228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.408267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.408496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.408591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.408769] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.408884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.409424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.409424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.409424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.409424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.409424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.409705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.409705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.409705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.409854] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 909.475642] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.476148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.476148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.476148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.476541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.489590] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 909.505901] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.506146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.506262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.507034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.533926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.534176] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.534330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.534388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.534553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.534636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.534730] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 909.586384] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.586568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.586637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.586870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.587046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.605222] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 909.795172] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: SUCCESS [ 909.795350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.812050] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6984856-6c1b-4d02-a5b7-08f98ac851be: rpc.has_security_group_logging(os_id): False [ 909.824318] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.824767] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.825211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.825620] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.826375] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.826375] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4beef149-4a16-4e46-93f5-d170ced68ea1 not found, creating... [ 909.826782] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.826782] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.826875] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.827957] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.828127] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.828361] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.828535] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.828736] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.828888] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.829045] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.829196] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4beef149-4a16-4e46-93f5-d170ced68ea1 is going to be created. [ 909.830894] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: SUCCESS [ 909.831167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.835626] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.835780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.836189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.836189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.836189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.836637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.836637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.836637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.836637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.836637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.837114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.837114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.837114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.837114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.837259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.837345] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.837423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.837504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.838135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.838135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.838135] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be created. [ 909.871431] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 909.871698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.872933] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 909.873237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.874784] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: SUCCESS [ 909.875083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.875756] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 909.875929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.876862] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: SUCCESS [ 909.876981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.877190] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 909.877350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.878243] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: SUCCESS [ 909.878243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.881531] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.881758] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.881890] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.882195] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.882423] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.882646] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.910963] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0e675472-d48d-433b-8e1f-0de238fa10c1 None None] Enqueued Resource ID: 445efcc4-484c-46b0-9689-b9d946a33e0f with Priority: HIGHEST for action port [ 909.911517] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 445efcc4-484c-46b0-9689-b9d946a33e0f with Priority: HIGHEST for action port [ 909.911817] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-445efcc4-484c-46b0-9689-b9d946a33e0f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.911941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-445efcc4-484c-46b0-9689-b9d946a33e0f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.912034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-445efcc4-484c-46b0-9689-b9d946a33e0f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.912378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-445efcc4-484c-46b0-9689-b9d946a33e0f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.912471] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('445efcc4-484c-46b0-9689-b9d946a33e0f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.921792] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.922137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.922137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.922246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.922416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.935430] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 909.976744] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 909.977288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.414756] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 445efcc4-484c-46b0-9689-b9d946a33e0f [ 910.415111] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.415111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.415111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.415316] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.415409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.415586] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:445efcc4-484c-46b0-9689-b9d946a33e0f already deleted. [ 910.415675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-445efcc4-484c-46b0-9689-b9d946a33e0f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.459334] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 in Status: SUCCESS [ 910.459519] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 deletion is rescheduled due to dependency. [ 910.459631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.573022] env[69238]: INFO networking_nsxv3.common.synchronization [req-575399a2-684c-4513-bb55-1f11f859752f req-3ff3fbef-2190-4485-9287-b37160c01028 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 910.573022] env[69238]: INFO networking_nsxv3.common.synchronization [req-575399a2-684c-4513-bb55-1f11f859752f req-3ff3fbef-2190-4485-9287-b37160c01028 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 910.573022] env[69238]: INFO networking_nsxv3.common.synchronization [req-575399a2-684c-4513-bb55-1f11f859752f req-3ff3fbef-2190-4485-9287-b37160c01028 service nova] Enqueued Resource ID: 4beef149-4a16-4e46-93f5-d170ced68ea1 with Priority: HIGHEST for action port [ 910.573022] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 910.573022] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 910.573022] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4beef149-4a16-4e46-93f5-d170ced68ea1 with Priority: HIGHEST for action port [ 910.573713] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.573713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.573713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.573713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.574030] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.574751] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.574883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.574996] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4beef149-4a16-4e46-93f5-d170ced68ea1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.575679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.575679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.575981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.576091] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4beef149-4a16-4e46-93f5-d170ced68ea1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.080667] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.080786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.080973] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4beef149-4a16-4e46-93f5-d170ced68ea1 with status ACTIVE [ 911.081221] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.081318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.081318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.081516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.081606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.081774] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.081882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.082019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.082114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.082184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.082376] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.082490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.082556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.082647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.082712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.082793] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4beef149-4a16-4e46-93f5-d170ced68ea1 is going to be updated. [ 911.084921] env[69238]: INFO networking_nsxv3.common.synchronization [None req-710acba3-71bc-40aa-bc36-4bb3c155aaf3 tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_rules [ 911.085561] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_rules [ 911.086531] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.086531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.086780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.086864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.086922] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.113294] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.113474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.113550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.114253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.114253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.114253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4beef149-4a16-4e46-93f5-d170ced68ea1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.172227] env[69238]: INFO networking_nsxv3.common.synchronization [None req-cc7cc809-4d10-471c-affe-16cb3c0fde3f tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_rules [ 911.172947] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_rules [ 911.173405] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.173563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.513614] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 911.513985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.514273] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.514398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.514398] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.612809] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.612809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.612809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.612809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.612809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.612809] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f already deleted. [ 911.612809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.612809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.612809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.612809] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.620012] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 911.620012] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 deletion is rescheduled due to dependency. [ 911.620012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.620012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.620012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.620012] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.620287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.620287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.620402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.620625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.620799] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.949491] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 911.949491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.017083] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.017278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.017361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.017663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.017847] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.017953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.018037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.018201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.018403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.018403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.018499] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.123432] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.135083] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.135223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.135300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.135540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.135642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.135741] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f already deleted. [ 912.135821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.521040] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.521040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.521040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.521552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.521552] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.521552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.521766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.521801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.521902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.522012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.522321] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.522321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.522482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.522482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.522619] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.522719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.522967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.522967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.523084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.523159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.523251] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.628456] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.025574] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17abedf8-39e0-48a5-82ba-2806c6053ebe: rpc.has_security_group_logging(os_id): False [ 913.048240] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.048240] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.048240] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.048240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.051419] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.051419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.051419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.051419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.056299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.056299] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 913.132119] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.132299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.132375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.132656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.133019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.134656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.134897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.134897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.135157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.135291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.135434] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 913.160263] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 913.206608] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.206807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.206881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.207076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.207299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.221252] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 915.180296] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 915.180745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.180745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.180989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.181302] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.233087] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 915.233307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.233524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.233756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.233949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.234088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.234154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.234404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.234494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.234582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.234674] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.688178] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.688355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.688355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.688608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.688770] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.688867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.688945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.689134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.689226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.689315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.689404] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.699233] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e9fcfee-c042-4320-b017-d39bed8a9f55 req-90bbc530-75ae-404f-b3cf-98e1cb7e19f2 tempest-ServerMetadataTestJSON-1269964747 tempest-ServerMetadataTestJSON-1269964747-project-member] Enqueued Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_members [ 915.699823] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGHEST for action security_group_members [ 915.704988] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.704988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.704988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.704988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.704988] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.704988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.704988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.704988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.704988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.704988] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.737400] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.737558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.737666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.737893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.738074] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.738622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.738695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.738838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.738914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.739036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.739220] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.739432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.739432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.739600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.739693] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.739783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.739842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.740017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.740695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.740824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.740941] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.765657] env[69238]: INFO networking_nsxv3.common.synchronization [req-c3ac7b5f-8178-4dbf-b26a-90ed61d251c0 req-b58b32cd-9c27-43b4-bfec-36ede7b14dc9 tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 915.766494] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 915.766819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.766948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.767078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.767336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.767545] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.767713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.767820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.768149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.768309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.768448] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.800400] env[69238]: INFO networking_nsxv3.common.synchronization [req-bd6f898c-37c7-41fa-bbde-be32f680748d req-6a1dff1f-915b-406c-99be-4f9c3f62c10a tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 915.802289] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 915.803734] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.803921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.804044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.804463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.804743] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.805082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.805216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.805456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.805660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.805864] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.979982] env[69238]: INFO networking_nsxv3.common.synchronization [req-00e810c2-7a49-4867-857b-b793d5976482 req-f26ac341-2579-494e-ad1e-53ef83d640ec tempest-MultipleCreateTestJSON-1847930330 tempest-MultipleCreateTestJSON-1847930330-project-member] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 915.980531] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGHEST for action security_group_members [ 915.980828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.980936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.193686] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.193686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.209030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.209030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.209030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.209030] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 is going to be updated. [ 916.243935] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9df4a22-2e58-46f6-9dc8-bffb28401a54: rpc.has_security_group_logging(os_id): False [ 916.253091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.253245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.253331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.253586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.253753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.259390] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-99439cc7-72fc-402a-8b6d-50a11103f4f9 tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 916.260836] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 916.261340] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.261770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.261770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.261940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.262098] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.262257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.262356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.262558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.262712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.263667] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.270927] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.273952] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: IN_PROGRESS for 2s [ 916.277831] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.277984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.278068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.278306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.278398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.278608] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.278693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.278829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.278967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.279128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.279452] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.279623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.279740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.279975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.280724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.281089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.281290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.281421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.281694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.281851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.282033] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 916.308612] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.371949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.371949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.371949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.371949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.371949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.385844] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 916.765739] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.765950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.765950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.766234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.773141] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.789330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.789330] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.789330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.789330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.789330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.789330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.789727] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 916.810911] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.815959] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.816130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.816203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.816491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.816900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.828693] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 916.900612] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-365c5360-8089-4438-af57-bb5012cfdd40 tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 916.901192] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 916.901487] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.901583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.276026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.276367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.276367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.276476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.276565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.276666] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 917.306313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.306414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.306466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.306646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.306822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.312720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.313046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.313222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.313391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.313474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.313569] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 917.317339] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 917.346733] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.346904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.346953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.347182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.347332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.358577] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 917.423940] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.424199] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-875" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.424326] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-875" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.424671] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-875" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.424946] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.425120] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.425239] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.425480] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.425646] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.425871] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.425988] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.426107] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.426215] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.426324] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.426429] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.426562] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.447174] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.447325] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.447466] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.447715] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-875" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.448297] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-6e082007-e845-47a1-aff7-1fdd7d635200 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.448297] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.448466] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.448772] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.448936] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e082007-e845-47a1-aff7-1fdd7d635200',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.952801] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.953144] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.953300] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.953625] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.953794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.953981] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 6e082007-e845-47a1-aff7-1fdd7d635200 not found, creating... [ 917.954436] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.954692] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.954900] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.955250] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.955444] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.955859] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.956055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.956198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.956446] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.956591] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.956732] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 6e082007-e845-47a1-aff7-1fdd7d635200 is going to be created. [ 917.987904] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.987904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.987904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.987904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.987904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.987904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.284704] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 in Status: SUCCESS [ 918.285021] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 deletion is rescheduled due to dependency. [ 918.285021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.399508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 918.399508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.661278] env[69238]: INFO networking_nsxv3.common.synchronization [req-3be4c95f-ce93-4945-b738-8fe4030c2f5e req-00f4e942-0028-4a47-8ce7-deddae40af7a tempest-MigrationsAdminTest-400782288 tempest-MigrationsAdminTest-400782288-project-member] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 918.661885] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 918.662277] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.662435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.662523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.662720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.662935] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.668122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.668369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.668469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.668591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.668718] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.839864] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 918.840184] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 deletion is rescheduled due to dependency. [ 918.840317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.840491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.840736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.840974] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.841107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.841197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.841331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.841416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.841514] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.034572] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.034572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.034572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.034572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.034572] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.034572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.034572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.034572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.034572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.034572] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.034572] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.034572] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.035078] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.035078] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.035078] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.035078] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.054712] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.054882] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 919.055029] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.055212] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-380" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.055560] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-e03a8b4d-9fc1-487e-8c33-a12524a970a5 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.055783] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.055958] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.056341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.056521] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03a8b4d-9fc1-487e-8c33-a12524a970a5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.171479] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.173116] env[69238]: INFO networking_nsxv3.common.synchronization [req-d7bff1d9-6c84-4d91-af28-d95f2ab2d555 req-f7106f8a-59e4-4e08-9222-68f4d30b0c55 tempest-ServerAddressesTestJSON-1304762753 tempest-ServerAddressesTestJSON-1304762753-project-member] Enqueued Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_members [ 919.173746] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad with Priority: HIGHEST for action security_group_members [ 919.177766] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.177904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.177977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.178217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.178383] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.178488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.178548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.178721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.178836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.178885] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d9b6b76-7856-4e7e-a2a3-3e1756e445ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.326824] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 919.327212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.327212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.327413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.327599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.327772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.327835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.327992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.328089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.328185] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.343205] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-34f9b36f-e227-462e-909f-8d84ad4971ce service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 919.343382] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-34f9b36f-e227-462e-909f-8d84ad4971ce service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 919.343527] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-34f9b36f-e227-462e-909f-8d84ad4971ce service nova] Enqueued Resource ID: 6e082007-e845-47a1-aff7-1fdd7d635200 with Priority: HIGHEST for action port [ 919.343756] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 919.343949] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 919.344160] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e082007-e845-47a1-aff7-1fdd7d635200 with Priority: HIGHEST for action port [ 919.347913] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.348898] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.349452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.349531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.349737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.349821] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.351330] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.351434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.351638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e082007-e845-47a1-aff7-1fdd7d635200 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.351809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.351900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.352092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.352214] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e082007-e845-47a1-aff7-1fdd7d635200',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.367925] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 919.371214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.375135] env[69238]: INFO networking_nsxv3.common.synchronization [req-f579a731-6af7-4c68-a01b-234d12caa1e7 req-ae7e9d67-758d-4f14-8487-10781bf67be6 tempest-ServersWithSpecificFlavorTestJSON-1275212292 tempest-ServersWithSpecificFlavorTestJSON-1275212292-project-member] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 919.376293] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 919.376606] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.376720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.376791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.376989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.377156] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.377458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.377458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.377573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.377573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.377654] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.562139] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.562139] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.562271] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.562526] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.562751] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.562864] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port e03a8b4d-9fc1-487e-8c33-a12524a970a5 not found, creating... [ 919.563261] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.563422] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.563539] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.563757] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.563901] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.564213] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.564441] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.564486] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.564674] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.564852] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.564993] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: e03a8b4d-9fc1-487e-8c33-a12524a970a5 is going to be created. [ 919.587315] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.587315] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.587315] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.587315] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.587908] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.587908] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.674078] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.681287] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.681485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.681555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.681722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.682200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.682200] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.682200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.682200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.682528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.682528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.682528] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad is going to be updated. [ 919.731146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.731322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.731490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.731626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.731837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.746016] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad in Status: IN_PROGRESS for 2s [ 919.832754] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.833056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.833056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.833218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.833307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.833509] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.833603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.833659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.833809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.833900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.833959] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 919.858777] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.859164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.860071] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e082007-e845-47a1-aff7-1fdd7d635200 with status ACTIVE [ 919.860071] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.860071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.860071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.860071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.860071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.860497] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.860497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.860497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.860497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.860712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.860933] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.860933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.861094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.861227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.861350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.861482] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e082007-e845-47a1-aff7-1fdd7d635200 is going to be updated. [ 919.865730] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.867751] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.867914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.867991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.868186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.868323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.882111] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.882327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.882444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.882750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.884646] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 919.906224] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.906610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.906610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.906694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.906881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.906959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e082007-e845-47a1-aff7-1fdd7d635200" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.908163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.910452] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.910452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.910452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.910452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.910452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.910452] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 is going to be updated. [ 919.943401] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.943538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.943538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.945836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.945836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.954421] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: IN_PROGRESS for 2s [ 920.177086] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.177272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.177346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.177566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.177661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.177792] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be updated. [ 920.214623] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.215544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.215663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.215871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.216112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.228570] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: IN_PROGRESS for 2s [ 920.309726] env[69238]: INFO networking_nsxv3.common.synchronization [req-3be4c95f-ce93-4945-b738-8fe4030c2f5e req-d5c45fbf-7828-4907-ae46-de8e6bc004bd service nova] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_rules [ 920.309923] env[69238]: INFO networking_nsxv3.common.synchronization [req-3be4c95f-ce93-4945-b738-8fe4030c2f5e req-d5c45fbf-7828-4907-ae46-de8e6bc004bd service nova] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 920.310079] env[69238]: INFO networking_nsxv3.common.synchronization [req-3be4c95f-ce93-4945-b738-8fe4030c2f5e req-d5c45fbf-7828-4907-ae46-de8e6bc004bd service nova] Enqueued Resource ID: e03a8b4d-9fc1-487e-8c33-a12524a970a5 with Priority: HIGHEST for action port [ 920.310327] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_rules [ 920.310455] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 920.310559] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03a8b4d-9fc1-487e-8c33-a12524a970a5 with Priority: HIGHEST for action port [ 920.311701] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.311839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.311963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.312304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.312388] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.313648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.313784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.314613] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-e03a8b4d-9fc1-487e-8c33-a12524a970a5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.314738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.314805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.315110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.315192] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e03a8b4d-9fc1-487e-8c33-a12524a970a5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.334402] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-906 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.334750] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-906" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.334862] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-906" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.335303] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-906" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.335702] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.335978] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.336168] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.336477] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.336746] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.336978] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.337179] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.337324] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.337485] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.337646] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.337831] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.338035] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.357220] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.357504] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.357724] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.357975] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-906" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.358440] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4233431e-cf46-4ff2-b4c7-e73b893b707d taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.358734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.358884] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.359231] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.359378] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4233431e-cf46-4ff2-b4c7-e73b893b707d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.370324] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.370469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.370531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.370711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.370800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.370897] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 920.399212] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.399212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.399212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.399486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.399574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.408706] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 920.817280] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.817418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.817638] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e03a8b4d-9fc1-487e-8c33-a12524a970a5 with status ACTIVE [ 920.817850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.817959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.818037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.819250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.819250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.819250] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.819250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.819250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.819250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.819250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.819613] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.819613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.819711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.819862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.819862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.819977] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e03a8b4d-9fc1-487e-8c33-a12524a970a5 is going to be updated. [ 920.840550] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.840724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.840767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.840971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.841126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.841289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e03a8b4d-9fc1-487e-8c33-a12524a970a5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.862100] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.862349] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.862478] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.862760] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.862935] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.863111] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4233431e-cf46-4ff2-b4c7-e73b893b707d not found, creating... [ 920.863383] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.863546] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.863666] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.863917] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.864041] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.864383] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.864547] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.864667] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.864879] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.865032] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.865177] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4233431e-cf46-4ff2-b4c7-e73b893b707d is going to be created. [ 920.890267] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.890508] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.890758] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.890979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.891175] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.891407] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.767428] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad in Status: SUCCESS [ 921.767675] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9b6b76-7856-4e7e-a2a3-3e1756e445ad deletion is rescheduled due to dependency. [ 921.767675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9b6b76-7856-4e7e-a2a3-3e1756e445ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.770587] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-dbdb7346-3b4e-4d1e-b4b2-84626d104e63 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 921.770778] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-dbdb7346-3b4e-4d1e-b4b2-84626d104e63 service nova] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 921.770953] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e66d3e3-38b1-4f1d-8b37-4a8bde7cd190 req-dbdb7346-3b4e-4d1e-b4b2-84626d104e63 service nova] Enqueued Resource ID: 4233431e-cf46-4ff2-b4c7-e73b893b707d with Priority: HIGHEST for action port [ 921.771186] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_rules [ 921.771314] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 921.771411] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4233431e-cf46-4ff2-b4c7-e73b893b707d with Priority: HIGHEST for action port [ 921.772471] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.772600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.772777] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.772862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.773055] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4233431e-cf46-4ff2-b4c7-e73b893b707d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.773159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.773221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.773425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.773507] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4233431e-cf46-4ff2-b4c7-e73b893b707d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.897340] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 921.897340] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe deletion is rescheduled due to dependency. [ 921.897560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.897647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.898013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.898205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.898324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.898384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.898545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.898625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.898742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.898859] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.898950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.899010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.899151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.899282] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.899371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.899427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.899559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.899630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.899790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.899879] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.964497] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: SUCCESS [ 921.964708] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 deletion is rescheduled due to dependency. [ 921.964824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.241114] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 922.241427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.242280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.242280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.242280] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.242280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.242280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.242542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.242542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.242609] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.276305] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4233431e-cf46-4ff2-b4c7-e73b893b707d with status ACTIVE [ 922.276811] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.277418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.277496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.278195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.278299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.278473] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.278583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.278657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.279451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.279451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.279451] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.279451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.279451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.279451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.279451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.279451] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4233431e-cf46-4ff2-b4c7-e73b893b707d is going to be updated. [ 922.304141] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.304293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.304396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.304692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.304928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.305174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4233431e-cf46-4ff2-b4c7-e73b893b707d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.402062] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17abedf8-39e0-48a5-82ba-2806c6053ebe: rpc.has_security_group_logging(os_id): False [ 922.419405] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 922.419622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.419787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.419997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.420204] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.420318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.420384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.420533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.420615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.420708] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.422421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.422686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.422686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.422811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.422893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.423083] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.423180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.423242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.423383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.423457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.423651] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.423739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.423789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.424123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.424215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.424406] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.424502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.424664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.424733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.424768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.424847] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be updated. [ 922.501908] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.501908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.501908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.502137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.502137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.525227] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: IN_PROGRESS for 2s [ 922.553551] env[69238]: INFO networking_nsxv3.common.synchronization [req-0e368502-0672-4445-b56c-73b34d9e7af0 req-1fb414f1-fd27-4678-8991-2b4d656e0c83 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 922.554147] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 922.554288] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.554438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.554503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.554756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.554960] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.555108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.555263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.555467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.555757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.555757] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.745905] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.926885] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.061031] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.061031] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.061031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.061031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 923.092724] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.092966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.092966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.093143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.093485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.102416] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 923.250208] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.429360] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.754057] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.754057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.754057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.755127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.755127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.755127] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be updated. [ 923.789776] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.789925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.789993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.790271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.790427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.800163] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: IN_PROGRESS for 2s [ 923.931853] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.932192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.932249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.932526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.932625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.932749] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 923.966476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.966476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.966476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.966476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.966476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.976909] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 924.556274] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe in Status: SUCCESS [ 924.556557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.729577] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e4ec765-2e87-412b-a730-ed0b99210450 req-b43a9296-b779-4e0f-8003-738c019300c2 tempest-ServersTestJSON-976768608 tempest-ServersTestJSON-976768608-project-member] Enqueued Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_members [ 924.730641] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_members [ 924.731012] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.731149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.731220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.731512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.731669] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.731787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.731859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.732202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.732314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.732424] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.116806] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 4s [ 925.199917] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.200204] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.200344] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.200723] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.201072] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.202449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.202449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.202449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.202449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.202449] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.202449] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.202449] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.202449] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.202926] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.203065] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.203260] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.236499] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.237078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.238174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.238927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.238927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.238927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.239121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.239161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.240029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.240029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.240029] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 already deleted. [ 925.240029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.240988] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.242580] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.242855] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.243097] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-167" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.243491] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4d4f8c71-cefc-46bd-bc59-0029998b2c08 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.243888] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.243888] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.244130] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.244277] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d4f8c71-cefc-46bd-bc59-0029998b2c08',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.750493] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.750493] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4d4f8c71-cefc-46bd-bc59-0029998b2c08 not found, creating... [ 925.750493] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.750493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.750942] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.750942] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.750942] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.750942] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.750942] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.750942] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4d4f8c71-cefc-46bd-bc59-0029998b2c08 is going to be created. [ 925.789252] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.789479] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.789607] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.791355] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.791355] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.791355] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.811262] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 925.811510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.811832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.811949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.812126] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.812346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.812346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.812476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.812528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.812614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.812718] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.988552] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 925.988876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.989085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.989451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.989554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.989665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.989735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.989905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.989978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.990096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.990200] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.991166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.991166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.991535] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.991671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.991751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.991932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.992279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.992279] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.019584] env[69238]: INFO networking_nsxv3.common.synchronization [req-828e3f0f-bba2-46ab-9b8e-6cc0aef4aba8 req-538f1b5d-c6ab-4aaa-ba79-312cd22aed66 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_members [ 926.020227] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGHEST for action security_group_members [ 926.020547] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.020671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.020737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.020936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.021096] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.021198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.021265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.021398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.021481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.021650] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.316101] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.316453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.316453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.316689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.316927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.317074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.317159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.317351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.317452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.317566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.317774] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.317965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.318056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.318210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.318397] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.318495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.318572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.318727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.318829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.318955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.319076] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.495351] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.496240] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.496354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.524062] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.524222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.524290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.524503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.524588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.524787] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.524878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.524993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.525089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.525162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.525246] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c is going to be updated. [ 926.571044] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.571220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.571306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.571573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.571733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.581708] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: IN_PROGRESS for 2s [ 926.757738] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e4ec765-2e87-412b-a730-ed0b99210450 req-2418b173-5bb9-4f11-a634-f84ee6e52998 service nova] Enqueued Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_rules [ 926.757738] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e4ec765-2e87-412b-a730-ed0b99210450 req-2418b173-5bb9-4f11-a634-f84ee6e52998 service nova] Enqueued Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_members [ 926.757738] env[69238]: INFO networking_nsxv3.common.synchronization [req-4e4ec765-2e87-412b-a730-ed0b99210450 req-2418b173-5bb9-4f11-a634-f84ee6e52998 service nova] Enqueued Resource ID: 4d4f8c71-cefc-46bd-bc59-0029998b2c08 with Priority: HIGHEST for action port [ 926.761396] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_rules [ 926.761396] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_members [ 926.761396] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d4f8c71-cefc-46bd-bc59-0029998b2c08 with Priority: HIGHEST for action port [ 926.761396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.761396] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.761396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.761396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.761396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.763544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.763544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.763544] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.763544] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d4f8c71-cefc-46bd-bc59-0029998b2c08 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.763544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.763544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.763544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.763544] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d4f8c71-cefc-46bd-bc59-0029998b2c08',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.823516] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9289966e-1f55-477f-8d5c-d3d5fe95527c: rpc.has_security_group_logging(os_id): False [ 926.850429] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.850579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.850659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.850880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.850976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.851224] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.851324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.851387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.851544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.851621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.851800] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.851892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.851965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.852123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.852198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.852386] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.852479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.852541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.852681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.852755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.852842] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be updated. [ 926.931667] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.931778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.931824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.932069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.932212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.947082] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: IN_PROGRESS for 2s [ 926.999942] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.129162] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 927.129379] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be deletion is rescheduled due to dependency. [ 927.129497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.266058] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.266949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.267351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.267754] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d4f8c71-cefc-46bd-bc59-0029998b2c08 with status ACTIVE [ 927.268198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.269023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.269023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.269023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.269023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.270029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.270029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.270029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.270406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.272137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.272137] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.272137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.272137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.272137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.272137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.272137] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d4f8c71-cefc-46bd-bc59-0029998b2c08 is going to be updated. [ 927.302905] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.303129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.303231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.303485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.303640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.303839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d4f8c71-cefc-46bd-bc59-0029998b2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.312841] env[69238]: INFO networking_nsxv3.common.synchronization [req-06e41aa3-1f68-495b-9a70-81ab1cbd7a8a req-443c4a6f-c3c0-4730-9e93-c4acd564eb53 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 927.312841] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 927.312841] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.312841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.312841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.313194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.313612] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.313766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.313818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.314045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.314141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.314363] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.502092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.502377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.502377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.502545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.502631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.502733] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 927.531603] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.531793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.531833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.532037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.532183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.540989] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 927.774026] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.816595] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.816779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.816823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.817055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.843396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.844394] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.844604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.844695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.845203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.845342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.845491] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 927.871176] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.871325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.871395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.871604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.871742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.883136] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 928.133660] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.133840] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.133973] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.134257] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.134513] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.134671] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.134789] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.135047] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.135203] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.135409] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.135523] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.135634] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.135759] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.135990] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.136138] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.136276] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.161380] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.162344] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.162344] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.162344] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.162344] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.162629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.162629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.164285] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.164444] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08455ff6-a9c5-45d0-aaa5-87a81fbcec42',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.276920] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.277098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.277172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.277395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.277490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.277588] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 is going to be created. [ 928.307066] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.307281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.307374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.308235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.308407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.320380] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 in Status: UNINITIALIZED for 2s [ 928.594527] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c in Status: SUCCESS [ 928.594527] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c deletion is rescheduled due to dependency. [ 928.594527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.667056] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.667305] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.667440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.667742] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.667996] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.668196] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 08455ff6-a9c5-45d0-aaa5-87a81fbcec42 not found, creating... [ 928.668498] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.668704] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.668844] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.669136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.669291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.669595] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.669759] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.669908] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.670195] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.670351] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.670516] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 08455ff6-a9c5-45d0-aaa5-87a81fbcec42 is going to be created. [ 928.698917] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.699247] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.699380] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.699674] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.699922] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.700185] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.963031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 928.963395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.553758] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 929.554013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.558021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.558021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.558021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.558021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.558999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.558999] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.720069] env[69238]: INFO networking_nsxv3.common.synchronization [req-06e41aa3-1f68-495b-9a70-81ab1cbd7a8a req-82a2bbab-9031-4f9d-9fdd-74c28e77dcfb service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 929.721115] env[69238]: INFO networking_nsxv3.common.synchronization [req-06e41aa3-1f68-495b-9a70-81ab1cbd7a8a req-82a2bbab-9031-4f9d-9fdd-74c28e77dcfb service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 929.721115] env[69238]: INFO networking_nsxv3.common.synchronization [req-06e41aa3-1f68-495b-9a70-81ab1cbd7a8a req-82a2bbab-9031-4f9d-9fdd-74c28e77dcfb service nova] Enqueued Resource ID: 08455ff6-a9c5-45d0-aaa5-87a81fbcec42 with Priority: HIGHEST for action port [ 929.721321] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 929.721499] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 929.721606] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08455ff6-a9c5-45d0-aaa5-87a81fbcec42 with Priority: HIGHEST for action port [ 929.722021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.722190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.722615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.722615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.722615] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.723662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.723662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.724368] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.724368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.724368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.724368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.724368] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08455ff6-a9c5-45d0-aaa5-87a81fbcec42',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.895922] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 929.896129] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 929.896251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.896423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.896643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.896832] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.896949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.897029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.897193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.897248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.897341] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.060664] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6bd121c-8d73-451b-96a4-3bfa5fbaad57: rpc.has_security_group_logging(os_id): False [ 930.080329] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.080499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.080566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.080794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.080888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.082033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.082033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.082033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.082033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.082033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.082033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.082033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.082033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.082033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.082614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.082614] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.082614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.082614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.082614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.082812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.082812] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 930.143886] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.144108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.144190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.144452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.144655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.158152] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 930.226856] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.227109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.227333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08455ff6-a9c5-45d0-aaa5-87a81fbcec42 with status ACTIVE [ 930.227582] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.227737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.227805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.228172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.228314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.228551] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.228664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.228740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.228916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.229117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.229311] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.229421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.229515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.229672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.229767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.230466] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08455ff6-a9c5-45d0-aaa5-87a81fbcec42 is going to be updated. [ 930.268222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.268222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.268222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.268532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.268532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.268769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08455ff6-a9c5-45d0-aaa5-87a81fbcec42" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.332240] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 in Status: SUCCESS [ 930.332522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.332636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.332940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333082] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.333214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.333273] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.333427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.333681] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.400979] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.835646] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.903760] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.038484] env[69238]: INFO networking_nsxv3.common.synchronization [req-3ba16589-90e9-4f54-babc-71fa4e48a3c1 req-8a260980-772d-43ab-81bd-ae7311280035 tempest-VolumesAssistedSnapshotsTest-1717929212 tempest-VolumesAssistedSnapshotsTest-1717929212-project-member] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_members [ 931.039359] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGHEST for action security_group_members [ 931.039815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.040299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.040402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.040652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.040879] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.041060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.041130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.041387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.041504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.041672] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.340398] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab3efdeb-971c-4ab9-84e2-455d55746f84: rpc.has_security_group_logging(os_id): False [ 931.360129] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.360278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.360389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.360553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.360682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.360878] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.360973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.361043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.361189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.361258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.361352] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 is going to be created. [ 931.406721] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.406966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.406966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.407204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.407311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.407414] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 931.426336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.426546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.426669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.426882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.427107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.439449] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 in Status: IN_PROGRESS for 2s [ 931.445134] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.445134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.445251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.445454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.445686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.459139] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 931.544499] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.544662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.544735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.544959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.545074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.545279] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.545377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.545440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.545592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.545669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.545947] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf is going to be updated. [ 931.592476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.592652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.592902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.592978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.593158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.604089] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: IN_PROGRESS for 2s [ 932.198908] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 932.199261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.199627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.199720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.199848] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.705221] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.705419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.705495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.705682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.705886] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.706021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.706107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.706290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.706374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.706466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.706598] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.213810] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.213810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.213810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.213810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.213810] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.214380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.214380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.214380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.214380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.214380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.214380] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.214633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.214633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.214633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.214830] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.214830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.214923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.215817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.215817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.215817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.215817] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.291363] env[69238]: INFO networking_nsxv3.common.synchronization [req-d906b76c-1206-4eba-8d92-da6087c2bccc req-07add876-5bb3-45a2-ac9c-39862436e57c tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 933.291886] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 933.292218] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.292319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.292382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.292573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.292722] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.292854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.292895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.293012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.293449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.293673] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.453858] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 in Status: SUCCESS [ 933.453858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.468858] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 933.469019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.469226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.469450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.469638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.469755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.470019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.470206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.470304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.470578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.470578] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.503722] env[69238]: INFO networking_nsxv3.common.synchronization [req-d906b76c-1206-4eba-8d92-da6087c2bccc req-3c2a3f9b-0da3-4656-81ca-54253ac10406 tempest-ServersTestMultiNic-1546694707 tempest-ServersTestMultiNic-1546694707-project-member] Enqueued Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 933.504250] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 with Priority: HIGHEST for action security_group_members [ 933.505034] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.505034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.615976] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf in Status: SUCCESS [ 933.616252] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf deletion is rescheduled due to dependency. [ 933.616360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.719089] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6bd121c-8d73-451b-96a4-3bfa5fbaad57: rpc.has_security_group_logging(os_id): False [ 933.740968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.741142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.741212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.741428] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.741522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.741720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.741817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.741877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.742032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.742110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.742307] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.742399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.742459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.742593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.742803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.742990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.743170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.743170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.743298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.743371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.743456] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 933.799563] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.810750] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.810896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.810964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.811216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.811369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.828518] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 933.973174] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.973347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.973444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.974294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.974294] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.974294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.974294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.974294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.974294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.974622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.974622] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.974710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.974710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.974879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.975046] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.975162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.975224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.975399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.975477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.976192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.976192] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.302534] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.479639] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cd8a4c5-7d49-440a-bef6-697272c0d01d: rpc.has_security_group_logging(os_id): False [ 934.499581] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.499768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.499832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.500138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.500248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.500466] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.500563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.500627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.500787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.501122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.501122] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.501248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.501248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.501344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.501421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.501595] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.501716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.501766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.501984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.502072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.502254] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 934.818636] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.818720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.823251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.823251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.823251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.823251] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.823251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.824047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.824047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.824047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.824047] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 934.844200] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 934.861716] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.861824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.861885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.862221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.862380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.877783] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 935.844066] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 935.844066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.857395] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 936.857768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.888120] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 936.888120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.888120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.888120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.888408] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.888408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.888665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.888665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.888882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.888882] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6bd121c-8d73-451b-96a4-3bfa5fbaad57',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.391535] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.391769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.391769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.391967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.392073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.392309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.392481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.392561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.392722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.392799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.392903] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 is going to be updated. [ 937.422360] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.422589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.422589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.422769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.422939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.432726] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: IN_PROGRESS for 2s [ 938.505213] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 938.505529] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 939.443868] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 in Status: SUCCESS [ 939.444088] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6bd121c-8d73-451b-96a4-3bfa5fbaad57 deletion is rescheduled due to dependency. [ 939.444204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6bd121c-8d73-451b-96a4-3bfa5fbaad57" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.980018] env[69238]: INFO networking_nsxv3.common.synchronization [req-557051f1-aca3-443f-b8fe-874c09ecd903 req-8478681d-0d3a-4ee9-99c1-7a957b6d1998 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 939.980654] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 939.981091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.981350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.981507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.981878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.982177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.982676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.982782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.983015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.983151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.983286] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.333534] env[69238]: INFO networking_nsxv3.common.synchronization [req-1192abc0-812b-4a16-8941-a4e521b74cfe req-39e40c65-9a9d-4a36-954a-10ee46644479 tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 940.334482] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 940.334482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.334663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.334663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.334759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.334902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.334997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.337737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.338120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.338821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.338981] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.400145] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.400145] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.400145] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.400145] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.400145] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.400145] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.400145] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.404093] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.404093] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.404093] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.404093] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.404093] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.404093] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.404093] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.404093] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.404093] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.423430] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.423606] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.423745] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.423931] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.424337] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.424527] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.424648] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.424981] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.425133] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.489186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.489186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.489186] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 already deleted. [ 940.489186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.843758] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.843944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.843994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.844253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.844365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.844875] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.844875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.844875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.844875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.845166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.845166] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 940.873067] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.873216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.873312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.873530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.873676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.882535] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 940.928319] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.928574] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.928706] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.928985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.929205] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.929438] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 not found, creating... [ 940.929760] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.929943] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.930082] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.930322] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.930467] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.930760] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.930919] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.931047] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.931258] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.931422] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.931570] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 is going to be created. [ 940.958460] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.958747] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.958794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.959111] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.959383] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.959668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.704102] env[69238]: INFO networking_nsxv3.common.synchronization [req-557051f1-aca3-443f-b8fe-874c09ecd903 req-9fbae19a-b86e-400e-a862-1dda178bcae5 service nova] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_rules [ 941.704595] env[69238]: INFO networking_nsxv3.common.synchronization [req-557051f1-aca3-443f-b8fe-874c09ecd903 req-9fbae19a-b86e-400e-a862-1dda178bcae5 service nova] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 941.704595] env[69238]: INFO networking_nsxv3.common.synchronization [req-557051f1-aca3-443f-b8fe-874c09ecd903 req-9fbae19a-b86e-400e-a862-1dda178bcae5 service nova] Enqueued Resource ID: 52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 with Priority: HIGHEST for action port [ 941.706606] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_rules [ 941.706768] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 941.706884] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 with Priority: HIGHEST for action port [ 941.707236] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.707433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.708084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.708084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.708084] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.711030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.711030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.711195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.711605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.711870] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.712049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.712155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.712413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.712582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.713119] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.715641] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.715641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.715843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.715896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.716063] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.217027] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.218645] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.218850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.221019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 with status ACTIVE [ 942.221019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.221019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.221019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.221623] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.221623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.221623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.221623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.221787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.221904] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7 is going to be updated. [ 942.247844] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.248070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.248170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.248434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.248636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.248862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52a4d6a2-1827-4bfb-8ad0-797f3eadf8c7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.720109] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.896075] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 942.896575] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 deletion is rescheduled due to dependency. [ 942.896743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.227061] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.227230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.227304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.227523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.227612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.227716] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be created. [ 943.256344] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.256344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.256344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.256344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.256344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.266085] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: UNINITIALIZED for 2s [ 943.801934] env[69238]: INFO networking_nsxv3.common.synchronization [req-7c16ea97-10f8-4d4b-bb6c-fa82a5ac5cc4 req-43ad3552-d23b-4042-99a0-9811b50a9313 tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 943.802608] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 943.802876] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.803054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.804108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.804355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.804539] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.804639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.804704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.805078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.805189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.805318] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.309765] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.309952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.310058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.310290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.310388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.310885] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.311022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.311097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.311296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.311347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.311441] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 944.356921] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.357128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.357128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.357344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.357484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.368031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 945.245268] env[69238]: INFO networking_nsxv3.common.synchronization [req-344a0856-7143-4fbb-8a9e-31e5d3faa8fb req-8a168aa4-421f-45c5-82e0-6e4266d552df tempest-ServersNegativeTestJSON-1827147972 tempest-ServersNegativeTestJSON-1827147972-project-member] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 945.245833] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 945.246639] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.246781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.246852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.247272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.247451] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.247559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.247661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.247788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.247878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.247975] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.276180] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: SUCCESS [ 945.276180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.276180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.276382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.276574] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.276691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.276755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.276901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.276983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.277082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.277179] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.750556] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.750728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.750784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.751029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.751132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.751336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.751436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.751498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.751799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.751799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.751799] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 already deleted. [ 945.751950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.780761] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.780947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.780995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.781225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.781394] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.781497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.781561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.781710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.781797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.781883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.782043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.782137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.782201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.782425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.782638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.782776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.782889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.783160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.783245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.783596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.783762] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.844298] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.844497] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.844634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.844992] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.845542] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.845724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.845864] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.846110] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.846270] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.846544] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.846672] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.846784] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.846892] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.847015] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.847127] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.847270] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.879242] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.879469] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.879616] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.879801] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.880181] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.880757] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.880757] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.880883] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.881024] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d97e4cea-5fb2-44c5-8349-e2aad8a3381f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.287559] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d15632cf-7f81-4a48-a43d-b6ab97d126e9: rpc.has_security_group_logging(os_id): False [ 946.309354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.309514] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.309582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.309799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.309890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.310130] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.310236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.310294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.310444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.310520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.310703] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.310810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.310878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.311052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.311130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.311311] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.311405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.311465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.311603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.311690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.311776] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be created. [ 946.386255] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 946.386449] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c deletion is rescheduled due to dependency. [ 946.386564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.387386] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.387572] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.387633] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.387918] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.388157] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.388360] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port d97e4cea-5fb2-44c5-8349-e2aad8a3381f not found, creating... [ 946.388688] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.389134] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.389134] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.389413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.389594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.389976] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.390214] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.390350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.390943] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.391138] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.391846] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f is going to be created. [ 946.394059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.394422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.394517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.394715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.394933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.408991] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: IN_PROGRESS for 2s [ 946.420485] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.420890] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.420890] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.421211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.421526] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.421848] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.686850] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e4b780ae-224f-4da7-b52b-c3c1b466b613 None None] Enqueued Resource ID: 24b41388-94cc-4a93-9507-9413a93cdafc with Priority: HIGHEST for action port [ 946.691613] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24b41388-94cc-4a93-9507-9413a93cdafc with Priority: HIGHEST for action port [ 946.692066] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-24b41388-94cc-4a93-9507-9413a93cdafc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.692228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24b41388-94cc-4a93-9507-9413a93cdafc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.692343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24b41388-94cc-4a93-9507-9413a93cdafc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.693513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24b41388-94cc-4a93-9507-9413a93cdafc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.693588] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24b41388-94cc-4a93-9507-9413a93cdafc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.122866] env[69238]: INFO networking_nsxv3.common.synchronization [req-344a0856-7143-4fbb-8a9e-31e5d3faa8fb req-8b419cb3-b4b6-4b4d-91ae-3eeb732a5073 service nova] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_rules [ 947.122866] env[69238]: INFO networking_nsxv3.common.synchronization [req-344a0856-7143-4fbb-8a9e-31e5d3faa8fb req-8b419cb3-b4b6-4b4d-91ae-3eeb732a5073 service nova] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 947.122866] env[69238]: INFO networking_nsxv3.common.synchronization [req-344a0856-7143-4fbb-8a9e-31e5d3faa8fb req-8b419cb3-b4b6-4b4d-91ae-3eeb732a5073 service nova] Enqueued Resource ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f with Priority: HIGHEST for action port [ 947.122866] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_rules [ 947.122866] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 947.122866] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f with Priority: HIGHEST for action port [ 947.124319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.130607] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.130607] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.130607] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.130607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.130607] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.131377] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.131601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.131743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.131977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.132164] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d97e4cea-5fb2-44c5-8349-e2aad8a3381f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.197333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24b41388-94cc-4a93-9507-9413a93cdafc [ 947.197554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.197726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.197800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.198024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.198132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.198248] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24b41388-94cc-4a93-9507-9413a93cdafc already deleted. [ 947.198331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24b41388-94cc-4a93-9507-9413a93cdafc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.636349] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.636687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.636687] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.637552] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d97e4cea-5fb2-44c5-8349-e2aad8a3381f with status ACTIVE [ 947.638710] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.638710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.638710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.638710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.638710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.638710] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.638710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.638710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.638710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.639049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.643499] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.643499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.643499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.643499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.643499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.643499] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f is going to be updated. [ 947.664256] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.664256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.664256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.664513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.664694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.664861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.781690] env[69238]: INFO networking_nsxv3.common.synchronization [req-342c738b-3e61-40bf-9ce3-0d6fc1afa972 req-904afe73-11c5-4170-b951-c6451805db94 tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_members [ 947.782477] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_members [ 947.783337] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.783337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.783337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.783337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.783337] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.783337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.783337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.783595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.783698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.783744] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.834876] env[69238]: INFO networking_nsxv3.common.synchronization [None req-7d956b5f-04f9-4f78-9e07-832918a80cec tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 947.835432] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 947.835743] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.835870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.835931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.838897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.838991] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.947725] env[69238]: INFO networking_nsxv3.common.synchronization [None req-a81e43f5-313c-49c4-a5df-c499d06d0353 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 947.948551] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 947.949324] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.949324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.132018] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.132018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.132173] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.132388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.134030] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.134030] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.134030] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.134030] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.134030] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.134030] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.134030] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.134030] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.134511] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.134511] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.134511] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.134708] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.141970] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.154075] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.154312] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.154491] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.155195] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-64" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.155195] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-20db1ee4-654d-47ec-9406-4a2ac9dd888c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.155195] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.155480] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.155834] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.156030] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20db1ee4-654d-47ec-9406-4a2ac9dd888c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.286433] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.286605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.286676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.286904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.286997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.287229] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.287332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.287394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.287548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.287623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.287706] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f already deleted. [ 948.287785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.361933] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.362089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.362166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.362385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.362480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.362581] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 already deleted. [ 948.362665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.362829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.362988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.363087] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.423238] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: SUCCESS [ 948.423498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.562914] env[69238]: INFO networking_nsxv3.common.synchronization [None req-2b54e711-5535-4899-86bd-4eb723330d6c None None] Enqueued Resource ID: 83386985-3de5-4831-b90a-d5306de03f3a with Priority: HIGHEST for action port [ 948.563215] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83386985-3de5-4831-b90a-d5306de03f3a with Priority: HIGHEST for action port [ 948.563644] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-83386985-3de5-4831-b90a-d5306de03f3a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.563776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83386985-3de5-4831-b90a-d5306de03f3a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.563876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83386985-3de5-4831-b90a-d5306de03f3a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.564214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83386985-3de5-4831-b90a-d5306de03f3a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.564301] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83386985-3de5-4831-b90a-d5306de03f3a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.644579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.645021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.645021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.645221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.645332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.645516] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be created. [ 948.658394] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.658657] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.658776] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.659097] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.659263] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.659517] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 20db1ee4-654d-47ec-9406-4a2ac9dd888c not found, creating... [ 948.659710] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.659875] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.660044] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.660414] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.660596] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.660937] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.661472] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.662081] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.662602] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.662765] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.662972] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 20db1ee4-654d-47ec-9406-4a2ac9dd888c is going to be created. [ 948.682348] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.682785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.682785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.683119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.683119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.693984] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.694361] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.694714] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.695053] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.695294] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.695595] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.697738] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: UNINITIALIZED for 2s [ 948.890324] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.890324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.890324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.890324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.890324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.890324] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 already deleted. [ 948.890324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.066008] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83386985-3de5-4831-b90a-d5306de03f3a [ 949.066259] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.066400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.066471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.066685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.067619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.067758] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83386985-3de5-4831-b90a-d5306de03f3a already deleted. [ 949.067856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83386985-3de5-4831-b90a-d5306de03f3a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.433655] env[69238]: INFO networking_nsxv3.common.synchronization [req-342c738b-3e61-40bf-9ce3-0d6fc1afa972 req-00156486-e4eb-4797-b1c7-d7ad6cf0d151 service nova] Enqueued Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_rules [ 949.433962] env[69238]: INFO networking_nsxv3.common.synchronization [req-342c738b-3e61-40bf-9ce3-0d6fc1afa972 req-00156486-e4eb-4797-b1c7-d7ad6cf0d151 service nova] Enqueued Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_members [ 949.434198] env[69238]: INFO networking_nsxv3.common.synchronization [req-342c738b-3e61-40bf-9ce3-0d6fc1afa972 req-00156486-e4eb-4797-b1c7-d7ad6cf0d151 service nova] Enqueued Resource ID: 20db1ee4-654d-47ec-9406-4a2ac9dd888c with Priority: HIGHEST for action port [ 949.434762] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_rules [ 949.434910] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_members [ 949.434998] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20db1ee4-654d-47ec-9406-4a2ac9dd888c with Priority: HIGHEST for action port [ 949.435287] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.435409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.435476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.435681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.435763] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.436639] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.436789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.436830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.436988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.437151] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.437249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.437298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.437444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.437527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.437617] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.439891] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-20db1ee4-654d-47ec-9406-4a2ac9dd888c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.440019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.440071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.440248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.440326] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20db1ee4-654d-47ec-9406-4a2ac9dd888c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.942155] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.943224] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.943555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.943786] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20db1ee4-654d-47ec-9406-4a2ac9dd888c with status ACTIVE [ 949.943850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.943960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.944043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.944240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.944329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.944501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.944596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.944656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.944805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.944880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.945065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.945160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.945220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.945356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.945429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.945517] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20db1ee4-654d-47ec-9406-4a2ac9dd888c is going to be updated. [ 949.971198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.971198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.971198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.971934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.971934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.972072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20db1ee4-654d-47ec-9406-4a2ac9dd888c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.444352] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.505104] env[69238]: INFO networking_nsxv3.common.synchronization [req-ae271ac9-2753-45cf-a9af-68b39e12b0e8 req-4a2b50bd-6bd6-4c42-9e26-e8b91cd02591 tempest-ServersWithSpecificFlavorTestJSON-1275212292 tempest-ServersWithSpecificFlavorTestJSON-1275212292-project-member] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 950.505372] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 950.505697] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.505815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.505877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.506237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.506419] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.506517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.506890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.506890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.506890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.507082] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.710120] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 950.710353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.710526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.710867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.710952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.711074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.711137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.711303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.711362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.711556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.711556] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.843825] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.844163] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.844364] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.844799] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.845242] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.847042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.847042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.847042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.847042] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.847042] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.847042] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.847042] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.847292] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.847495] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.847702] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.847948] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.868496] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.868688] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 950.868833] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.869023] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-40" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.869364] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-5333f968-31a2-4264-b286-3f00746d4c60 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.869542] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.869666] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.869997] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.870157] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5333f968-31a2-4264-b286-3f00746d4c60',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.952069] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.952069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.952069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.952069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.952069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.952541] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f is going to be created. [ 950.976857] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.977009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.977085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.977304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.977462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.988392] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f in Status: UNINITIALIZED for 2s [ 951.012017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.012017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.012017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.012017] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 is going to be updated. [ 951.039169] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.039471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.039569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.039787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.039940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.049089] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: IN_PROGRESS for 2s [ 951.214071] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.214298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.214298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.214530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.214677] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.214782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.214849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.215012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.215117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.215204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.215442] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.215540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.215618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.216179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.216179] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.216179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.216179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.216547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.216547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.216547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.216547] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.374400] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.374400] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.374400] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.374400] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.374400] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.374400] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 5333f968-31a2-4264-b286-3f00746d4c60 not found, creating... [ 951.374734] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.374794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.374945] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.375226] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.375401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.375710] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.375867] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.375982] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.376830] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.377104] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.377278] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 5333f968-31a2-4264-b286-3f00746d4c60 is going to be created. [ 951.403785] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.403785] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.403785] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.403785] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.403785] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.403785] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.721841] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78f92256-b4da-4815-aefb-cda5bc01bc11: rpc.has_security_group_logging(os_id): False [ 951.753304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.753470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.753554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.753772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.753873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.754089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.754222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.754691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.754691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.754691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.754691] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.757158] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.757158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.757158] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be created. [ 951.868530] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.868705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.868747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.868959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.869160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.898043] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 952.173251] env[69238]: INFO networking_nsxv3.common.synchronization [req-ae271ac9-2753-45cf-a9af-68b39e12b0e8 req-67f71ecc-fc1a-4dfb-9a25-e49937e62f78 service nova] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 952.173251] env[69238]: INFO networking_nsxv3.common.synchronization [req-ae271ac9-2753-45cf-a9af-68b39e12b0e8 req-67f71ecc-fc1a-4dfb-9a25-e49937e62f78 service nova] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 952.173251] env[69238]: INFO networking_nsxv3.common.synchronization [req-ae271ac9-2753-45cf-a9af-68b39e12b0e8 req-67f71ecc-fc1a-4dfb-9a25-e49937e62f78 service nova] Enqueued Resource ID: 5333f968-31a2-4264-b286-3f00746d4c60 with Priority: HIGHEST for action port [ 952.173251] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_rules [ 952.177215] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 952.177215] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333f968-31a2-4264-b286-3f00746d4c60 with Priority: HIGHEST for action port [ 952.177215] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.177215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.177215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.177215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.177215] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.178617] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.178755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.178973] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-5333f968-31a2-4264-b286-3f00746d4c60 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.179091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.179153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.179409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.179484] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5333f968-31a2-4264-b286-3f00746d4c60',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.682512] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.682512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.682729] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5333f968-31a2-4264-b286-3f00746d4c60 with status ACTIVE [ 952.682729] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.685089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.685089] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.685089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.685089] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5333f968-31a2-4264-b286-3f00746d4c60 is going to be updated. [ 952.707222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.707367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.707441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.707656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.707791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.707949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5333f968-31a2-4264-b286-3f00746d4c60" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.998380] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f in Status: SUCCESS [ 952.998624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.998795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.999023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.999218] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.999353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.999651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.999846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.999929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.000028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.000196] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.060505] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: SUCCESS [ 953.060704] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 deletion is rescheduled due to dependency. [ 953.060821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.060990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.061249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.061443] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.061560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.061624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.061773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.061852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.061951] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.505234] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.567542] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.909348] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 953.909920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.008114] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c338f61-f5a9-448d-a2fc-f2e38883909f: rpc.has_security_group_logging(os_id): False [ 954.028368] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.028368] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.028368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.028368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f is going to be created. [ 954.074668] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.090894] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.091109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.091184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.091394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.091584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.104195] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f in Status: IN_PROGRESS for 2s [ 954.577515] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.578922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.579096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.580453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.581187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.581306] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 is going to be updated. [ 954.600183] env[69238]: INFO networking_nsxv3.common.synchronization [req-92fec8b4-1211-4055-b993-ba022f55d239 req-9682acc9-1326-4468-91e8-055327628d80 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 954.600850] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 954.601188] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.601309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.601375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.601577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.601721] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.601815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.601874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.603032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.603189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.603300] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.630028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.630028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.630028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.630028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.630028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.640789] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: IN_PROGRESS for 2s [ 955.110731] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.110920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.110999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.111240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.111339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.111815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.111956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.112043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.112247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.112337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.112439] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 955.146944] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.147253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.147358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.147658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.147903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.159523] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 956.118237] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f in Status: SUCCESS [ 956.118528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.654704] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: SUCCESS [ 956.654704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.654704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.656264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.656264] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.656264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.656264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.656264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.656264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.656264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.656264] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.158818] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.169725] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 957.169725] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 957.169725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.667477] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6b0ebb8-e601-44fa-aac4-0c8f25377737: rpc.has_security_group_logging(os_id): False [ 957.685772] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.685930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.685930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.686182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.686235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.686505] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.686633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.686707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.686850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.686926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.687028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 is going to be updated. [ 957.762510] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.762717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.762812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.763323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.763323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.778588] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: IN_PROGRESS for 2s [ 958.393552] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c323f8fc-c6a0-4c26-a0d9-6268a01c0398 None None] Enqueued Resource ID: 76638895-67de-4d64-af21-0e6931314b28 with Priority: HIGHEST for action port [ 958.393927] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76638895-67de-4d64-af21-0e6931314b28 with Priority: HIGHEST for action port [ 958.394333] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-76638895-67de-4d64-af21-0e6931314b28 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.394459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76638895-67de-4d64-af21-0e6931314b28" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.394523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76638895-67de-4d64-af21-0e6931314b28" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.394772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76638895-67de-4d64-af21-0e6931314b28" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.394849] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76638895-67de-4d64-af21-0e6931314b28',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.902963] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76638895-67de-4d64-af21-0e6931314b28 [ 958.903264] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.903403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.906055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.906328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.906436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.906584] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76638895-67de-4d64-af21-0e6931314b28 already deleted. [ 958.906686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76638895-67de-4d64-af21-0e6931314b28" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.794818] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: SUCCESS [ 959.795431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.770606] env[69238]: INFO networking_nsxv3.common.synchronization [None req-39b98108-d875-4ac2-a793-3f1d95808b53 None None] Enqueued Resource ID: aaf98be5-7994-494f-89e4-853cf6b32846 with Priority: HIGHEST for action port [ 960.771232] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf98be5-7994-494f-89e4-853cf6b32846 with Priority: HIGHEST for action port [ 960.771607] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaf98be5-7994-494f-89e4-853cf6b32846 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.771772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaf98be5-7994-494f-89e4-853cf6b32846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.771842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaf98be5-7994-494f-89e4-853cf6b32846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.772402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaf98be5-7994-494f-89e4-853cf6b32846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.772510] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaf98be5-7994-494f-89e4-853cf6b32846',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.277234] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaf98be5-7994-494f-89e4-853cf6b32846 [ 961.277234] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.277234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.277234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.277234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.277234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.277234] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaf98be5-7994-494f-89e4-853cf6b32846 already deleted. [ 961.277234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaf98be5-7994-494f-89e4-853cf6b32846" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.296610] env[69238]: INFO networking_nsxv3.common.synchronization [req-e63165a0-7a1b-43ce-bbde-dbd5874dbb8a req-af4e1ae2-0fff-4e47-8287-90e9834c0d29 tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 961.297347] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 961.297795] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.298062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.298213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.298615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.298876] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.299195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.299345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.299577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.300130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.300376] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.802740] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.305373] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.807988] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.808209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.808291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.808624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.808791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.808911] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 962.841242] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.841368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.842225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.842457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.842872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.852335] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 964.863779] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 964.864086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.877497] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e5c52b85-348d-48fd-8405-b2c69269808b None None] Enqueued Resource ID: f05efeb6-e7c3-42f5-b039-10e786af8a3c with Priority: HIGHEST for action port [ 964.877796] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f05efeb6-e7c3-42f5-b039-10e786af8a3c with Priority: HIGHEST for action port [ 964.878421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f05efeb6-e7c3-42f5-b039-10e786af8a3c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.878573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f05efeb6-e7c3-42f5-b039-10e786af8a3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.878662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f05efeb6-e7c3-42f5-b039-10e786af8a3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.878908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f05efeb6-e7c3-42f5-b039-10e786af8a3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.878992] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05efeb6-e7c3-42f5-b039-10e786af8a3c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.383755] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f05efeb6-e7c3-42f5-b039-10e786af8a3c [ 965.383755] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.383755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.383755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.383755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.383755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.383755] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f05efeb6-e7c3-42f5-b039-10e786af8a3c already deleted. [ 965.383755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f05efeb6-e7c3-42f5-b039-10e786af8a3c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.391501] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e18a129c-7e0a-4458-8309-401ccd1b0726 None None] Enqueued Resource ID: 54dd44f3-0b8c-44b3-93d7-becac20a50c5 with Priority: HIGHEST for action port [ 967.391981] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54dd44f3-0b8c-44b3-93d7-becac20a50c5 with Priority: HIGHEST for action port [ 967.392335] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-54dd44f3-0b8c-44b3-93d7-becac20a50c5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.392758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54dd44f3-0b8c-44b3-93d7-becac20a50c5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.392758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54dd44f3-0b8c-44b3-93d7-becac20a50c5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.392857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54dd44f3-0b8c-44b3-93d7-becac20a50c5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.392902] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54dd44f3-0b8c-44b3-93d7-becac20a50c5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.898446] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54dd44f3-0b8c-44b3-93d7-becac20a50c5 [ 967.898798] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.898974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.899071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.899417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.899730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.899730] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54dd44f3-0b8c-44b3-93d7-becac20a50c5 already deleted. [ 967.899856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54dd44f3-0b8c-44b3-93d7-becac20a50c5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.253216] env[69238]: INFO networking_nsxv3.common.synchronization [req-1302ffe8-e7cc-4003-9e25-ec5623a7ccf4 req-5eacb2d6-7039-4ed5-9a55-03eea4699647 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 968.253807] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 968.256202] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.256384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.256472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.256831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.257030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.257160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.257677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.257895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.258028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.258183] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.760759] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.761150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.761150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.761243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.761324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.761526] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.761625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.761680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.761831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.761905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.761981] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be updated. [ 968.790673] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.790826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.790902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.791207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.791356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.800414] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: IN_PROGRESS for 2s [ 968.891357] env[69238]: INFO networking_nsxv3.common.synchronization [None req-93a25600-7fb1-4695-a471-2e6227595b7f tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_rules [ 968.892015] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_rules [ 968.894976] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.895172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.895245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.895498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.895649] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.947114] env[69238]: INFO networking_nsxv3.common.synchronization [req-8f1c7eda-2092-4a0e-836c-8df1afebbbf7 req-d60acc29-5f14-4e23-9992-7ad5a57a2360 tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 968.950126] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 968.950126] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.950126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.950126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.950126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.950126] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.950126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.950126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.950126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.950126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.950126] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.041557] env[69238]: INFO networking_nsxv3.common.synchronization [None req-a1efe56b-efd3-4d2b-b46f-94e1185900f6 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_rules [ 969.042135] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_rules [ 969.042450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.042554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.386036] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.386275] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.386403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.386802] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.387159] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.388308] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.388501] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.388829] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.388990] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.389251] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.389382] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.389500] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.389612] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.389729] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.389839] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.389985] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.411128] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.411128] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.411128] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.411128] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-958" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.411300] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-3486177f-55b6-455f-b73a-4d12f80e407b taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.411483] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.411613] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.411975] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.412140] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3486177f-55b6-455f-b73a-4d12f80e407b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.423616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.423616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.423616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.426607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.426767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.426877] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee already deleted. [ 969.426963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.427538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.427739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.428067] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.454176] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.454176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.454176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.454176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.474129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.475094] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.475094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.475094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.475094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.475094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.475094] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 969.504017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.504017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.504017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.504017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.504017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.511367] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 969.914954] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.914954] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.916061] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.916061] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.916061] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.916061] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 3486177f-55b6-455f-b73a-4d12f80e407b not found, creating... [ 969.916061] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.916291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.916291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.918780] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.918780] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.918780] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.918780] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.918780] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.918780] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.918780] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.918780] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 3486177f-55b6-455f-b73a-4d12f80e407b is going to be created. [ 969.941624] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.941624] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.941624] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.941939] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.942309] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.942453] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.950912] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.951049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.951115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.951319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.951408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.951501] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee already deleted. [ 969.951585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.580193] env[69238]: INFO networking_nsxv3.common.synchronization [None req-3c5c7cb1-ef62-44ab-929f-232c7c3f6036 None None] Enqueued Resource ID: 9e3dff2f-50cb-424f-842f-d08a912c2023 with Priority: HIGHEST for action port [ 970.580193] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e3dff2f-50cb-424f-842f-d08a912c2023 with Priority: HIGHEST for action port [ 970.580193] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e3dff2f-50cb-424f-842f-d08a912c2023 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.580193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e3dff2f-50cb-424f-842f-d08a912c2023" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.580193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e3dff2f-50cb-424f-842f-d08a912c2023" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.580193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e3dff2f-50cb-424f-842f-d08a912c2023" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.580193] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e3dff2f-50cb-424f-842f-d08a912c2023',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.813058] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: SUCCESS [ 970.813058] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 deletion is rescheduled due to dependency. [ 970.813058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.844281] env[69238]: INFO networking_nsxv3.common.synchronization [req-8f1c7eda-2092-4a0e-836c-8df1afebbbf7 req-21ea8400-e262-4bdc-84d5-1f549c2ebfce service nova] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_rules [ 970.844281] env[69238]: INFO networking_nsxv3.common.synchronization [req-8f1c7eda-2092-4a0e-836c-8df1afebbbf7 req-21ea8400-e262-4bdc-84d5-1f549c2ebfce service nova] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 970.844281] env[69238]: INFO networking_nsxv3.common.synchronization [req-8f1c7eda-2092-4a0e-836c-8df1afebbbf7 req-21ea8400-e262-4bdc-84d5-1f549c2ebfce service nova] Enqueued Resource ID: 3486177f-55b6-455f-b73a-4d12f80e407b with Priority: HIGHEST for action port [ 970.844281] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_rules [ 970.844281] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 970.844281] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3486177f-55b6-455f-b73a-4d12f80e407b with Priority: HIGHEST for action port [ 970.844281] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.844958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.845151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.845569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.846294] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.850152] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.850152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.850152] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-3486177f-55b6-455f-b73a-4d12f80e407b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.850152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.850152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.850152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.850152] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3486177f-55b6-455f-b73a-4d12f80e407b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.084023] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e3dff2f-50cb-424f-842f-d08a912c2023 [ 971.084763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.084763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.084763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.084763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.084978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.084978] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e3dff2f-50cb-424f-842f-d08a912c2023 already deleted. [ 971.085103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e3dff2f-50cb-424f-842f-d08a912c2023" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.353832] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.354245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.354477] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3486177f-55b6-455f-b73a-4d12f80e407b with status ACTIVE [ 971.354670] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.354781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.354849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.355090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.355184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.355358] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.355444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.355514] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.355680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.355757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.355935] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.356037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.356119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.356263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.356337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.356422] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3486177f-55b6-455f-b73a-4d12f80e407b is going to be updated. [ 971.378482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.378703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.378703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.378962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.379117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.379299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3486177f-55b6-455f-b73a-4d12f80e407b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.500033] env[69238]: INFO networking_nsxv3.common.synchronization [req-034952d4-8a4a-46bc-8651-e841d12ab37e req-9f2965a9-b275-4803-8d0b-5ae7dac056b7 tempest-VolumesAdminNegativeTest-1660961456 tempest-VolumesAdminNegativeTest-1660961456-project-member] Enqueued Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_members [ 971.500033] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_members [ 971.500033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b90b4f01-4981-48aa-a11f-0269ff567c26 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.500033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.500033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.500033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.500033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.500033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.500033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.500033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.500033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.500033] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.524518] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 971.524709] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 deletion is rescheduled due to dependency. [ 971.524824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.524981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.525202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.525382] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.525494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.525554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.525703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.525781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.525873] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.003366] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.003366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.003366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.003621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.003621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.003687] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.003786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.003838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.004053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.004053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.004405] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b90b4f01-4981-48aa-a11f-0269ff567c26 already deleted. [ 972.004405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.028477] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.111616] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.111987] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.111987] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.112273] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.112554] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.112717] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.112860] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.114171] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.114403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.114640] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.114784] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.116715] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.116715] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.116715] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.116715] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.116715] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.139021] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.139021] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.139021] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.139021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.139021] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.139021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.139021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.139021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.139021] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.531034] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.642185] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.642185] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.642352] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.642570] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.642725] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.642877] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 not found, creating... [ 972.643152] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.643754] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.643754] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.643754] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.643985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.645161] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.645415] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.645592] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.645886] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.646320] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.646545] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 is going to be created. [ 972.672201] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.672201] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.672201] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.672201] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.672433] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.672710] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.763657] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c60d471a-d551-4d75-a23c-25a5e5d3d813 None None] Enqueued Resource ID: 734f0144-8c5b-45de-9ea6-5d5d0c9ee152 with Priority: HIGHEST for action port [ 972.763708] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0144-8c5b-45de-9ea6-5d5d0c9ee152 with Priority: HIGHEST for action port [ 972.764263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-734f0144-8c5b-45de-9ea6-5d5d0c9ee152 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.764383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-734f0144-8c5b-45de-9ea6-5d5d0c9ee152" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.764448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-734f0144-8c5b-45de-9ea6-5d5d0c9ee152" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.765988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-734f0144-8c5b-45de-9ea6-5d5d0c9ee152" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.765988] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('734f0144-8c5b-45de-9ea6-5d5d0c9ee152',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.034874] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.035061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.035253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.035303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.035394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.035503] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 973.064485] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.064652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.064711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.064934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.065088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.074190] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 973.267154] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 734f0144-8c5b-45de-9ea6-5d5d0c9ee152 [ 973.267445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.267552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.267962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.267962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.267962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.268120] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:734f0144-8c5b-45de-9ea6-5d5d0c9ee152 already deleted. [ 973.268190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-734f0144-8c5b-45de-9ea6-5d5d0c9ee152" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.511913] env[69238]: INFO networking_nsxv3.common.synchronization [req-034952d4-8a4a-46bc-8651-e841d12ab37e req-5da636b1-6a59-4539-ba61-28b2d62f8950 service nova] Enqueued Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_rules [ 973.512599] env[69238]: INFO networking_nsxv3.common.synchronization [req-034952d4-8a4a-46bc-8651-e841d12ab37e req-5da636b1-6a59-4539-ba61-28b2d62f8950 service nova] Enqueued Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_members [ 973.512599] env[69238]: INFO networking_nsxv3.common.synchronization [req-034952d4-8a4a-46bc-8651-e841d12ab37e req-5da636b1-6a59-4539-ba61-28b2d62f8950 service nova] Enqueued Resource ID: 4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 with Priority: HIGHEST for action port [ 973.512599] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_rules [ 973.512599] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_members [ 973.512890] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 with Priority: HIGHEST for action port [ 973.513215] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b90b4f01-4981-48aa-a11f-0269ff567c26 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.513336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.513404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.513645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.513727] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.515284] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b90b4f01-4981-48aa-a11f-0269ff567c26 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.515365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.516537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.516537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.516537] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.516537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.516537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.516537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.516537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.516537] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.517977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.517977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.517977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.517977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.519236] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.020719] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.024471] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b90b4f01-4981-48aa-a11f-0269ff567c26 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.024471] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 with status ACTIVE [ 974.024471] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.024471] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.024471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.024471] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.025168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.025168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.025168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.025168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.025168] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69 is going to be updated. [ 974.045009] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.045009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.045009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.045191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.045310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.045480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dc7e21e-dfd6-4be6-8bc3-002cc43f3c69" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.526882] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.029563] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.029563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.029563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.029876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.029876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.029876] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b90b4f01-4981-48aa-a11f-0269ff567c26 is going to be created. [ 975.060409] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.060608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.060660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.060882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.061123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.076919] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b90b4f01-4981-48aa-a11f-0269ff567c26 in Status: UNINITIALIZED for 2s [ 975.088594] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 975.089205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.089486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.089817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.090518] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.090518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.090518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.090712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.090789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.090905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.091029] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.596559] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.596559] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.596559] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.596559] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.596559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.597483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.597483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.597483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.597483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.597483] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.101397] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2: rpc.has_security_group_logging(os_id): False [ 976.122616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.122616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.122616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.122770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.122770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.122961] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.123058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.123116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.123576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.123576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.123576] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.123720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.123720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.123827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.123899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.128248] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.128385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.128449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.128649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.128700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.128933] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 976.198473] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.198619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.198683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.199168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.199435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.218417] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 976.763101] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff258823-f174-4c83-b405-e068fc8f540e req-679f1cb3-3e46-489b-9895-05e1495f1c52 tempest-ServersTestJSON-976768608 tempest-ServersTestJSON-976768608-project-member] Enqueued Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_members [ 976.763950] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGHEST for action security_group_members [ 976.764892] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.765074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.765197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.765424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.765619] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.765875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.765969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.766202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.766335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.766460] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.087179] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b90b4f01-4981-48aa-a11f-0269ff567c26 in Status: SUCCESS [ 977.087504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.087676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.087911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.088092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.088203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.088280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.088414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.088496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.088579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.088666] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.269121] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.269121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.269369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.269432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.269543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.269752] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.269856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.269922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.270150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.270233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.270338] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 is going to be updated. [ 977.304294] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.304452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.304523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.304742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.304891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.322208] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 in Status: IN_PROGRESS for 2s [ 977.594133] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b90b4f01-4981-48aa-a11f-0269ff567c26 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.594133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.594133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.594351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.594385] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.594622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.594622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.594725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.594847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.594980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.595164] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b90b4f01-4981-48aa-a11f-0269ff567c26 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.595270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.595345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.595513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.595666] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.595791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.595866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.596053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.596148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.596306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.596352] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.102188] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b90b4f01-4981-48aa-a11f-0269ff567c26: rpc.has_security_group_logging(os_id): False [ 978.128702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.128897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.128975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.129193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.129285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.129500] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.129598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.129650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.129803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.129890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.130079] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.130192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.130244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.130362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.130433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.130615] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.130706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.130772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.131443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.131577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.131671] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b90b4f01-4981-48aa-a11f-0269ff567c26 is going to be created. [ 978.228719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.228719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.228719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.228719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.228719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.236790] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 978.237092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.242669] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b90b4f01-4981-48aa-a11f-0269ff567c26 in Status: IN_PROGRESS for 2s [ 979.336818] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 in Status: SUCCESS [ 979.336818] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 deletion is rescheduled due to dependency. [ 979.336818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.946369] env[69238]: INFO networking_nsxv3.common.synchronization [req-720c783a-a12d-493b-8ff5-abe9d63a7257 req-be05d454-a16d-40f8-a6d5-81a0e740328c tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 979.947158] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 979.947650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.948799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.948799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.948799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.950657] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.950657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.950657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.950657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.950657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.950657] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.253835] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b90b4f01-4981-48aa-a11f-0269ff567c26 in Status: SUCCESS [ 980.254092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.453100] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.453100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.453100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.453100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.453100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.454134] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.454350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.454420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.454611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.454696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.454860] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 980.483668] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.483898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.483898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.484150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.484331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.494571] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 980.560880] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.561236] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.561236] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.561507] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.561783] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.561950] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.562265] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.562526] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.563094] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.563094] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.563094] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.563274] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.563388] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.563518] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.563634] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.563779] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.587788] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.587919] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 980.588267] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.588524] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.588905] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-465f6a80-4459-4d60-9bf4-950c0d752dfc taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.589182] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.589329] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.589677] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.589835] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465f6a80-4459-4d60-9bf4-950c0d752dfc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.092564] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.092837] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.092923] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.093255] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.093421] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.093586] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 465f6a80-4459-4d60-9bf4-950c0d752dfc not found, creating... [ 981.093865] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.094017] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.094146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.094375] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.094525] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.094858] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.095960] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.096645] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.096645] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.096645] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.096785] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 465f6a80-4459-4d60-9bf4-950c0d752dfc is going to be created. [ 981.121076] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.121359] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.121493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.121854] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.122034] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.122301] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.822050] env[69238]: INFO networking_nsxv3.common.synchronization [None req-096ceb55-71a6-42c0-ac68-da79f3d5bf0e None None] Enqueued Resource ID: bb8376dd-0d98-4b61-8b43-3086f8dbbdf7 with Priority: HIGHEST for action port [ 981.822050] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8376dd-0d98-4b61-8b43-3086f8dbbdf7 with Priority: HIGHEST for action port [ 981.824140] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb8376dd-0d98-4b61-8b43-3086f8dbbdf7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.824140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb8376dd-0d98-4b61-8b43-3086f8dbbdf7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.824140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb8376dd-0d98-4b61-8b43-3086f8dbbdf7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.824140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb8376dd-0d98-4b61-8b43-3086f8dbbdf7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.824140] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb8376dd-0d98-4b61-8b43-3086f8dbbdf7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.046663] env[69238]: INFO networking_nsxv3.common.synchronization [req-720c783a-a12d-493b-8ff5-abe9d63a7257 req-c880b5dc-da5b-48e6-a5bd-347f0a5fa473 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 982.046814] env[69238]: INFO networking_nsxv3.common.synchronization [req-720c783a-a12d-493b-8ff5-abe9d63a7257 req-c880b5dc-da5b-48e6-a5bd-347f0a5fa473 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 982.046961] env[69238]: INFO networking_nsxv3.common.synchronization [req-720c783a-a12d-493b-8ff5-abe9d63a7257 req-c880b5dc-da5b-48e6-a5bd-347f0a5fa473 service nova] Enqueued Resource ID: 465f6a80-4459-4d60-9bf4-950c0d752dfc with Priority: HIGHEST for action port [ 982.047512] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 982.047646] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 982.047741] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465f6a80-4459-4d60-9bf4-950c0d752dfc with Priority: HIGHEST for action port [ 982.048503] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.048691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.048817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.049462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.049625] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.050645] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.050755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.051167] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-465f6a80-4459-4d60-9bf4-950c0d752dfc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.051337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.051481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.051677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.051919] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465f6a80-4459-4d60-9bf4-950c0d752dfc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.328495] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb8376dd-0d98-4b61-8b43-3086f8dbbdf7 [ 982.328495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.328495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.328495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.328495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.328495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.328495] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb8376dd-0d98-4b61-8b43-3086f8dbbdf7 already deleted. [ 982.328495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb8376dd-0d98-4b61-8b43-3086f8dbbdf7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.411527] env[69238]: INFO networking_nsxv3.common.synchronization [req-2bfe3a36-6c54-4b89-9259-557d71762ec5 req-28cbc08a-3106-458b-b87d-638dc876e8f7 tempest-ServersTestBootFromVolume-656707009 tempest-ServersTestBootFromVolume-656707009-project-member] Enqueued Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_members [ 982.411783] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69fbfff4-4d12-49da-9085-7d562819c005 with Priority: HIGHEST for action security_group_members [ 982.415431] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-69fbfff4-4d12-49da-9085-7d562819c005 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.415431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.415569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.417235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.417235] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.417235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.417235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.417235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.417235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.417235] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69fbfff4-4d12-49da-9085-7d562819c005',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.508361] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 982.508361] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 deletion is rescheduled due to dependency. [ 982.508447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.508577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.508794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.509700] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.509700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.509700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.509700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.509700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.509700] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.555620] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.555749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.555975] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 465f6a80-4459-4d60-9bf4-950c0d752dfc with status ACTIVE [ 982.556167] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.556263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.556373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.556554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.556655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.556875] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.557040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.557076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.557247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.557346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.557536] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.557635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.557706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.557863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.557948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.560353] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 465f6a80-4459-4d60-9bf4-950c0d752dfc is going to be updated. [ 982.585187] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.585265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.585297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.585556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.585714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.585947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-465f6a80-4459-4d60-9bf4-950c0d752dfc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.918554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.918949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.918949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.919222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.011858] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.041101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.041601] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.041742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.041805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.042041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.042125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.042224] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69fbfff4-4d12-49da-9085-7d562819c005 is going to be updated. [ 983.078219] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.078219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.078219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.078472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.078649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.089011] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69fbfff4-4d12-49da-9085-7d562819c005 in Status: IN_PROGRESS for 2s [ 983.514907] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.794154] env[69238]: INFO networking_nsxv3.common.synchronization [req-1f55f00c-b605-495d-8f03-a6c2adc71f45 req-fa7571d8-96c7-4776-91a0-695c3751c4cd tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 983.794154] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 983.794154] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.794154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.794154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.798067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.798433] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.798556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.798620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.798822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.798910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.799042] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.019757] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.020194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.020437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.020437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.022727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.022727] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 984.057229] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.057383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.057453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.057652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.057885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.072549] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 984.302855] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.303086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.303437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.303437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.303528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.303764] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.303898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.303967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.304164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.304242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.304333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 already deleted. [ 984.304412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.393498] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.393767] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.393915] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.394271] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.394623] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.394736] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.395253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.396324] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.396505] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.396728] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.396848] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.396974] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.397103] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.397220] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.397331] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.397473] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.416809] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.417051] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 984.417223] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.417412] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.417743] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-40919351-7ce4-4696-a840-52a672ceacc5 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.417926] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.418072] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.418506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.418602] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40919351-7ce4-4696-a840-52a672ceacc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.508186] env[69238]: INFO networking_nsxv3.common.synchronization [req-a527e361-7c2c-4f60-be8f-fe5b384cd91f req-c3740a1a-d2ee-4215-86ca-d62d89e9f998 tempest-ImagesOneServerNegativeTestJSON-1397179055 tempest-ImagesOneServerNegativeTestJSON-1397179055-project-member] Enqueued Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 984.508186] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 with Priority: HIGHEST for action security_group_members [ 984.508186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.508186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.508186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.508186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.508186] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.508186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.508186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.509074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.509376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.509720] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1eab02-6277-4c21-b07d-5b4f5b13a3f2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.928020] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.928020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.928020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.928020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.928020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.928020] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 40919351-7ce4-4696-a840-52a672ceacc5 not found, creating... [ 984.928020] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.928020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.928694] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.928694] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.928694] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.929129] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.929592] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.929742] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.930026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.930234] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.930398] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 40919351-7ce4-4696-a840-52a672ceacc5 is going to be created. [ 984.953820] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.954131] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.954510] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.954819] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.955136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.955510] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.013415] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.013576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.013653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.014199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.014199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.014335] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.014335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.014414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.014556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.017918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.017918] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 is going to be updated. [ 985.077126] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.077445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.077445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.077661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.077815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.086978] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: IN_PROGRESS for 2s [ 985.100484] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69fbfff4-4d12-49da-9085-7d562819c005 in Status: SUCCESS [ 985.100735] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69fbfff4-4d12-49da-9085-7d562819c005 deletion is rescheduled due to dependency. [ 985.100847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69fbfff4-4d12-49da-9085-7d562819c005" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.346895] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9f277979-323a-4eee-a662-9526a911ec35 None None] Enqueued Resource ID: 77754234-8263-4696-8502-0255010ee822 with Priority: HIGHEST for action port [ 985.347822] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77754234-8263-4696-8502-0255010ee822 with Priority: HIGHEST for action port [ 985.347822] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-77754234-8263-4696-8502-0255010ee822 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.348041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77754234-8263-4696-8502-0255010ee822" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.348041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77754234-8263-4696-8502-0255010ee822" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.348634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77754234-8263-4696-8502-0255010ee822" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.348634] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77754234-8263-4696-8502-0255010ee822',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.785605] env[69238]: INFO networking_nsxv3.common.synchronization [req-1f55f00c-b605-495d-8f03-a6c2adc71f45 req-49a28ecd-e554-479e-b068-a0448d4a22f5 service nova] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 985.785857] env[69238]: INFO networking_nsxv3.common.synchronization [req-1f55f00c-b605-495d-8f03-a6c2adc71f45 req-49a28ecd-e554-479e-b068-a0448d4a22f5 service nova] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 985.787547] env[69238]: INFO networking_nsxv3.common.synchronization [req-1f55f00c-b605-495d-8f03-a6c2adc71f45 req-49a28ecd-e554-479e-b068-a0448d4a22f5 service nova] Enqueued Resource ID: 40919351-7ce4-4696-a840-52a672ceacc5 with Priority: HIGHEST for action port [ 985.787547] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 985.787547] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 985.787547] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40919351-7ce4-4696-a840-52a672ceacc5 with Priority: HIGHEST for action port [ 985.787547] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.787547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.787547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.789747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.789865] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.791334] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.791502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.791554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.792178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.792365] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.792778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.792778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.793588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.793738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.793890] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.795033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-40919351-7ce4-4696-a840-52a672ceacc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.795178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.795247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.795469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.795657] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40919351-7ce4-4696-a840-52a672ceacc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.853918] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77754234-8263-4696-8502-0255010ee822 [ 985.853918] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.853918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.853918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.854150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.854150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.854267] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77754234-8263-4696-8502-0255010ee822 already deleted. [ 985.854381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77754234-8263-4696-8502-0255010ee822" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.001637] env[69238]: INFO networking_nsxv3.common.synchronization [req-64f14dab-5d8c-480d-8511-b252962cba36 req-36c60a31-3fcd-411e-b2d6-ed2ef8bf98c3 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 986.002236] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 986.002729] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.002729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.002729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.003167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.003167] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.003167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.003289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.003340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.003420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.003510] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.085210] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.085210] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.085210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.085857] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.298627] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.298936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.299194] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.300118] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40919351-7ce4-4696-a840-52a672ceacc5 with status ACTIVE [ 986.300319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.300425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.300489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.300686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.300773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.300940] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.301073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.301104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.301941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.302085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.302300] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.302460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.305094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.305094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.305094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.305094] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40919351-7ce4-4696-a840-52a672ceacc5 is going to be updated. [ 986.322119] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.322746] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.323209] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.323790] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.325951] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.325951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.325951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.325951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.325951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.327038] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.327471] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.327853] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.328249] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.331071] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.331071] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.331071] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.332337] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.335025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.335025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.335025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.335025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.335025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40919351-7ce4-4696-a840-52a672ceacc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.356662] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.356881] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.357058] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.357252] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.357600] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-531c215d-9fbf-4466-acc5-4709d98cd7e7 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.358602] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.359029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.359181] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.361029] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('531c215d-9fbf-4466-acc5-4709d98cd7e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.506574] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.506853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.507024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.507327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.507420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.507624] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.507768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.507902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.507970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.508048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.508202] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 986.536768] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.536768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.536768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.537029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.537154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.547860] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 986.588498] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.588664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.588736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.588960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.589245] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.589346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.589416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.589595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.589686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.589777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.589923] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.590076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.590122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.590290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.590474] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.590610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.590705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.590925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.591069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.591216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.591382] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.805627] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.866326] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.866326] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.866326] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.866326] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.866326] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.866326] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 531c215d-9fbf-4466-acc5-4709d98cd7e7 not found, creating... [ 986.866326] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.866326] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.866326] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.866878] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.867158] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.867599] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.867940] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.868298] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.868656] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.869043] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.874320] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 531c215d-9fbf-4466-acc5-4709d98cd7e7 is going to be created. [ 986.909643] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.910182] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.910812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.910908] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.912870] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.912870] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.095208] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9df4a22-2e58-46f6-9dc8-bffb28401a54: rpc.has_security_group_logging(os_id): False [ 987.098513] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 in Status: SUCCESS [ 987.098748] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1eab02-6277-4c21-b07d-5b4f5b13a3f2 deletion is rescheduled due to dependency. [ 987.098873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1eab02-6277-4c21-b07d-5b4f5b13a3f2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.121298] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.121555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.121664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.121986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.122169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.122481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.122648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.122747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.123019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.127635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.127951] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.128086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.128160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.128388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.128479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.128718] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.128826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.128891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.129316] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.129316] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.129316] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 987.253424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.253793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.253793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.254494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.254494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.278999] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 987.309202] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.309202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.309773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.310136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.310281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.310377] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be created. [ 987.365072] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.366016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.366016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.366016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.366016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.393545] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: UNINITIALIZED for 2s [ 987.872192] env[69238]: INFO networking_nsxv3.common.synchronization [req-64f14dab-5d8c-480d-8511-b252962cba36 req-84e39cd6-24df-436e-97ac-e90896971871 service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 987.872496] env[69238]: INFO networking_nsxv3.common.synchronization [req-64f14dab-5d8c-480d-8511-b252962cba36 req-84e39cd6-24df-436e-97ac-e90896971871 service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 987.872621] env[69238]: INFO networking_nsxv3.common.synchronization [req-64f14dab-5d8c-480d-8511-b252962cba36 req-84e39cd6-24df-436e-97ac-e90896971871 service nova] Enqueued Resource ID: 531c215d-9fbf-4466-acc5-4709d98cd7e7 with Priority: HIGHEST for action port [ 987.873234] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 987.873444] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 987.873565] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531c215d-9fbf-4466-acc5-4709d98cd7e7 with Priority: HIGHEST for action port [ 987.873858] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.873987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.874068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.874765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.874864] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.876432] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.876534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.876870] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-531c215d-9fbf-4466-acc5-4709d98cd7e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.877015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.877085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.877337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.877337] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('531c215d-9fbf-4466-acc5-4709d98cd7e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.377438] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.377773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.381034] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 531c215d-9fbf-4466-acc5-4709d98cd7e7 with status ACTIVE [ 988.381233] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.381391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.381465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.381657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.381746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.381917] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.382027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.382082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.382228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.382306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.382482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.382809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.382809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.382809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.382935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.382935] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 531c215d-9fbf-4466-acc5-4709d98cd7e7 is going to be updated. [ 988.406514] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.406627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.406661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.407267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.407267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.407267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-531c215d-9fbf-4466-acc5-4709d98cd7e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.560192] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 988.561070] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 988.561070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.561070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.561070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.561362] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.561545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.561640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.561830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.562015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.562129] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.582028] env[69238]: INFO networking_nsxv3.common.synchronization [req-427a0fac-b3fb-4fee-b82c-4e46fde58ffe req-3a434224-2c44-405d-8a52-17304951a821 tempest-VolumesAdminNegativeTest-1660961456 tempest-VolumesAdminNegativeTest-1660961456-project-member] Enqueued Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_members [ 988.582028] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b90b4f01-4981-48aa-a11f-0269ff567c26 with Priority: HIGHEST for action security_group_members [ 988.582028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b90b4f01-4981-48aa-a11f-0269ff567c26 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.582028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.582028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.582028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.582028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.582028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.582028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.582028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.582028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.582028] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b90b4f01-4981-48aa-a11f-0269ff567c26',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.064193] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.086113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.086332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.086394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.086731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.086825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.087918] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.087918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.087918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.087918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.087918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.087918] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b90b4f01-4981-48aa-a11f-0269ff567c26 is going to be updated. [ 989.120573] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.120717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.121228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.121228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.121228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.129951] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b90b4f01-4981-48aa-a11f-0269ff567c26 in Status: IN_PROGRESS for 2s [ 989.294913] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 989.295493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.403096] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 989.403383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.403497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.403713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.403902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.404031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.404099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.404248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.404329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.404411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.404500] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.568523] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.634686] env[69238]: INFO networking_nsxv3.common.synchronization [req-d4949794-c370-465f-8d54-8747bc20ed89 req-bf1c13e0-c8ac-47ef-86a4-170f556ed5c5 tempest-ServersNegativeTestJSON-1827147972 tempest-ServersNegativeTestJSON-1827147972-project-member] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 989.635631] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 989.636015] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.636442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.636595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.636866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.637147] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.637310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.637450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.637701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.638398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.638580] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.908695] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.073631] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.073631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.073631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.074133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.074133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.074133] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 990.107203] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.107203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.107203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.107203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.107203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.118374] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 990.144507] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.159927] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.160239] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.160396] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.160706] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.162393] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.163087] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.163433] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.163870] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.164230] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.164789] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.165042] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.165250] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.165535] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.165771] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.165950] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.166288] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.196225] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.196417] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.196564] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.196746] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.197184] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-dbc531f9-cc31-4d7b-af89-9560c8edb555 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.197327] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.197519] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.197822] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.197997] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc531f9-cc31-4d7b-af89-9560c8edb555',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.410914] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66936bcb-aef7-4123-ae9d-1753abcc41e7: rpc.has_security_group_logging(os_id): False [ 990.435282] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.435282] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.435282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.435282] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be created. [ 990.509371] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.509583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.509629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.509828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.510025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.530086] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 990.648783] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.702253] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.702253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.702253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.702253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.702253] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.702500] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port dbc531f9-cc31-4d7b-af89-9560c8edb555 not found, creating... [ 990.703569] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.703804] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.704215] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.704924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.705183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.705555] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.705736] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.705859] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.706143] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.706294] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.706457] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: dbc531f9-cc31-4d7b-af89-9560c8edb555 is going to be created. [ 990.733055] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.733250] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.733387] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.733702] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.733971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.734242] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.140173] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b90b4f01-4981-48aa-a11f-0269ff567c26 in Status: IN_PROGRESS for 4s [ 991.152053] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.152053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.152053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.152358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.152358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.152484] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be updated. [ 991.193342] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.193521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.193593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.193808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.193949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.208090] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 991.625029] env[69238]: INFO networking_nsxv3.common.synchronization [req-d4949794-c370-465f-8d54-8747bc20ed89 req-69701445-da97-4bdd-ab3e-dc08ee7b8984 service nova] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_rules [ 991.625029] env[69238]: INFO networking_nsxv3.common.synchronization [req-d4949794-c370-465f-8d54-8747bc20ed89 req-69701445-da97-4bdd-ab3e-dc08ee7b8984 service nova] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 991.625029] env[69238]: INFO networking_nsxv3.common.synchronization [req-d4949794-c370-465f-8d54-8747bc20ed89 req-69701445-da97-4bdd-ab3e-dc08ee7b8984 service nova] Enqueued Resource ID: dbc531f9-cc31-4d7b-af89-9560c8edb555 with Priority: HIGHEST for action port [ 991.625029] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_rules [ 991.625029] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 991.625029] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbc531f9-cc31-4d7b-af89-9560c8edb555 with Priority: HIGHEST for action port [ 991.625807] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.626159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.626324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.626661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.626829] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.629024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.629024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.629024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbc531f9-cc31-4d7b-af89-9560c8edb555 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.629024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.629024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.629024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.629024] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc531f9-cc31-4d7b-af89-9560c8edb555',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.130932] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 4s [ 992.131407] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.131602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.133324] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbc531f9-cc31-4d7b-af89-9560c8edb555 with status ACTIVE [ 992.133324] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.133324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.133324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.135033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.135188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.138043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.138043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.138043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.138043] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbc531f9-cc31-4d7b-af89-9560c8edb555 is going to be updated. [ 992.161169] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.161169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.161169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.161532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.161532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.161675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbc531f9-cc31-4d7b-af89-9560c8edb555" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.545923] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 992.548317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.724714] env[69238]: INFO networking_nsxv3.common.synchronization [None req-f5895aa3-8bc1-48f4-b056-60904756b413 None None] Enqueued Resource ID: 7fb541a7-31ec-4869-adc2-d9c1c811a310 with Priority: HIGHEST for action port [ 992.725513] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb541a7-31ec-4869-adc2-d9c1c811a310 with Priority: HIGHEST for action port [ 992.725973] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fb541a7-31ec-4869-adc2-d9c1c811a310 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.727589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fb541a7-31ec-4869-adc2-d9c1c811a310" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.727589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fb541a7-31ec-4869-adc2-d9c1c811a310" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.727589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fb541a7-31ec-4869-adc2-d9c1c811a310" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.727589] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fb541a7-31ec-4869-adc2-d9c1c811a310',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.155572] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b90b4f01-4981-48aa-a11f-0269ff567c26 in Status: SUCCESS [ 993.155728] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b90b4f01-4981-48aa-a11f-0269ff567c26 deletion is rescheduled due to dependency. [ 993.155777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b90b4f01-4981-48aa-a11f-0269ff567c26" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.220146] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 993.220146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.220146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.220146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.220146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.220146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.220146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.220146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.220146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.220146] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.231402] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fb541a7-31ec-4869-adc2-d9c1c811a310 [ 993.231679] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.231829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.231899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.232126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.232218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.232312] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fb541a7-31ec-4869-adc2-d9c1c811a310 already deleted. [ 993.232397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fb541a7-31ec-4869-adc2-d9c1c811a310" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.726046] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.142840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 994.143109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.143285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.143503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.143749] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.144108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.144108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.144108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.144450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.144450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.144450] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.230497] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.478931] env[69238]: INFO networking_nsxv3.common.synchronization [req-e82f7069-0079-4f44-9d6a-4139d19c16f9 req-7bbb1c76-604b-4205-907f-5607ecb90f69 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 994.479620] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 994.479937] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.481223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.481223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.481223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.481223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.481223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.481223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.481472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.481508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.481627] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.647993] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.648228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.648304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.648525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.648707] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.648809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.648871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.649058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.649174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.649271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.649416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.649510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.649570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.649713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.649851] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.649942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.650010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.650173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.650249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.650332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.650417] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.732757] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.733087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.733087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.733711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.733711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.733711] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be updated. [ 994.769443] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.770703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.770788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.771018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.771195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.782361] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 994.827916] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.828402] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.828402] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.828989] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.829077] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.829390] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.829561] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.829859] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.830069] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.830555] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.830717] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.830879] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.831087] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.831255] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.831542] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.831914] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.853316] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.853767] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.854372] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.854644] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.855454] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-aad30ae9-9be5-4f15-8238-d3285db1779c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.855666] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.855787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.856244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.856386] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad30ae9-9be5-4f15-8238-d3285db1779c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.987256] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.987256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.987256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.988361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.988361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.988361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.988361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.988361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.988614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.988710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.988749] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d already deleted. [ 994.988958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.153636] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cd8a4c5-7d49-440a-bef6-697272c0d01d: rpc.has_security_group_logging(os_id): False [ 995.172721] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.172721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.172721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.172721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.172721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.172975] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.172975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.173063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.173174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.173239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.173436] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.173533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.173569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.173704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.176042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.176042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.176042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.176042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.176042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.176042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.176042] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 995.246835] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.246835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.246835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.246835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.246835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.264962] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 995.305333] env[69238]: INFO networking_nsxv3.common.synchronization [None req-4ef52c1e-614e-48f7-bfec-f73d3e93c6c3 None None] Enqueued Resource ID: a7ad32be-dfad-434e-937d-57d7c7b97410 with Priority: HIGHEST for action port [ 995.307783] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ad32be-dfad-434e-937d-57d7c7b97410 with Priority: HIGHEST for action port [ 995.309557] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7ad32be-dfad-434e-937d-57d7c7b97410 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.309557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7ad32be-dfad-434e-937d-57d7c7b97410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.309557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7ad32be-dfad-434e-937d-57d7c7b97410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.309557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7ad32be-dfad-434e-937d-57d7c7b97410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.309557] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ad32be-dfad-434e-937d-57d7c7b97410',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.360269] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.360269] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.360269] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.360491] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.360607] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.360753] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port aad30ae9-9be5-4f15-8238-d3285db1779c not found, creating... [ 995.361050] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.361218] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.361336] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.361588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.361741] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.362271] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.362517] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.362779] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.363743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.363935] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.364110] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: aad30ae9-9be5-4f15-8238-d3285db1779c is going to be created. [ 995.389722] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.390013] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.390229] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.390562] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.390829] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.391084] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.581627] env[69238]: INFO networking_nsxv3.common.synchronization [None req-895f5cc9-ab06-4b41-aa5a-1c8ad216d589 None None] Enqueued Resource ID: 6b9cb638-fa6a-4632-884e-1e830450d2b7 with Priority: HIGHEST for action port [ 995.581916] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9cb638-fa6a-4632-884e-1e830450d2b7 with Priority: HIGHEST for action port [ 995.582496] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b9cb638-fa6a-4632-884e-1e830450d2b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.582623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b9cb638-fa6a-4632-884e-1e830450d2b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.582689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b9cb638-fa6a-4632-884e-1e830450d2b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.582940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b9cb638-fa6a-4632-884e-1e830450d2b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.587030] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b9cb638-fa6a-4632-884e-1e830450d2b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.813715] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7ad32be-dfad-434e-937d-57d7c7b97410 [ 995.817079] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.817079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.817079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.817079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.817079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.817079] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7ad32be-dfad-434e-937d-57d7c7b97410 already deleted. [ 995.817079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7ad32be-dfad-434e-937d-57d7c7b97410" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.086759] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b9cb638-fa6a-4632-884e-1e830450d2b7 [ 996.086759] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.086759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.086932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.087160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.087800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.087800] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b9cb638-fa6a-4632-884e-1e830450d2b7 already deleted. [ 996.087800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b9cb638-fa6a-4632-884e-1e830450d2b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.420129] env[69238]: INFO networking_nsxv3.common.synchronization [req-e82f7069-0079-4f44-9d6a-4139d19c16f9 req-ba99a011-663d-4603-bc98-b89f895fe515 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 996.420442] env[69238]: INFO networking_nsxv3.common.synchronization [req-e82f7069-0079-4f44-9d6a-4139d19c16f9 req-ba99a011-663d-4603-bc98-b89f895fe515 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 996.420686] env[69238]: INFO networking_nsxv3.common.synchronization [req-e82f7069-0079-4f44-9d6a-4139d19c16f9 req-ba99a011-663d-4603-bc98-b89f895fe515 service nova] Enqueued Resource ID: aad30ae9-9be5-4f15-8238-d3285db1779c with Priority: HIGHEST for action port [ 996.422136] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 996.422280] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 996.422390] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aad30ae9-9be5-4f15-8238-d3285db1779c with Priority: HIGHEST for action port [ 996.425720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.425720] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.425720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.425720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.425720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.427428] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.427428] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.427756] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-aad30ae9-9be5-4f15-8238-d3285db1779c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.427756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.427872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.428188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.428188] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad30ae9-9be5-4f15-8238-d3285db1779c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.803261] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 996.803531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.803682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.803902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.804112] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.804230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.804294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.804457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.804524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.804613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.804753] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.933523] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.933523] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.933523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.933523] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aad30ae9-9be5-4f15-8238-d3285db1779c with status ACTIVE [ 996.933523] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.933523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.933523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.933523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.933523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.933523] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.933523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.934448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.934448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.934448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.934448] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.934448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.935411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.935411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.935411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.935411] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aad30ae9-9be5-4f15-8238-d3285db1779c is going to be updated. [ 996.961377] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.961545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.961613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.961776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.961906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.962074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aad30ae9-9be5-4f15-8238-d3285db1779c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.282557] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 997.282817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.308601] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.308601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.308915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.308915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.309026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.309131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.309264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.309490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.309621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.309621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.309773] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.309836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.309885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.310013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.310198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.310345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.310404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.310540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.310619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.310703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.310794] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.437635] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.618515] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e945708c-2119-4490-aa6f-86733f568175 None None] Enqueued Resource ID: 62a145b2-8138-4709-adc3-7d947bc9b5b4 with Priority: HIGHEST for action port [ 997.619512] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62a145b2-8138-4709-adc3-7d947bc9b5b4 with Priority: HIGHEST for action port [ 997.620853] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-62a145b2-8138-4709-adc3-7d947bc9b5b4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.620853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62a145b2-8138-4709-adc3-7d947bc9b5b4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.620853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62a145b2-8138-4709-adc3-7d947bc9b5b4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.620853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62a145b2-8138-4709-adc3-7d947bc9b5b4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.620853] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62a145b2-8138-4709-adc3-7d947bc9b5b4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.813386] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78f92256-b4da-4815-aefb-cda5bc01bc11: rpc.has_security_group_logging(os_id): False [ 997.834392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.834392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.834392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.834392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.834962] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.834962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.834962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.834962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.834962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.834962] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be updated. [ 997.903693] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.903768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.903800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.904383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.904383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.917136] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 997.944916] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.945281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.945281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.947402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.947402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.947402] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be created. [ 997.989762] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.990095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.990095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.990566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.990566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.007954] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: UNINITIALIZED for 2s [ 998.131412] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62a145b2-8138-4709-adc3-7d947bc9b5b4 [ 998.131827] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.131985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.132075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.132295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.132382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.132484] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62a145b2-8138-4709-adc3-7d947bc9b5b4 already deleted. [ 998.132564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62a145b2-8138-4709-adc3-7d947bc9b5b4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.285223] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d8fd2ee9-e746-4146-ac1b-d2a78cd0e052 None None] Enqueued Resource ID: 4d5172a9-79d1-436d-a168-c02d118f5a55 with Priority: HIGHEST for action port [ 999.285555] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d5172a9-79d1-436d-a168-c02d118f5a55 with Priority: HIGHEST for action port [ 999.286094] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d5172a9-79d1-436d-a168-c02d118f5a55 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.286212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d5172a9-79d1-436d-a168-c02d118f5a55" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.286281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d5172a9-79d1-436d-a168-c02d118f5a55" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.286552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d5172a9-79d1-436d-a168-c02d118f5a55" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.286708] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d5172a9-79d1-436d-a168-c02d118f5a55',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.793481] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d5172a9-79d1-436d-a168-c02d118f5a55 [ 999.793481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.793481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.793481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.793481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.793481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.793481] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d5172a9-79d1-436d-a168-c02d118f5a55 already deleted. [ 999.793481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d5172a9-79d1-436d-a168-c02d118f5a55" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.933111] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 999.933706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.006903] env[69238]: INFO networking_nsxv3.common.synchronization [req-33fa7a29-e3e3-48fc-b1a8-c3ce450df566 req-43488d27-fda1-49da-b010-607cfb9ece76 tempest-ServersAdminTestJSON-1499817460 tempest-ServersAdminTestJSON-1499817460-project-member] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 1000.007538] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGHEST for action security_group_members [ 1000.007843] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.007962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.009475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.009746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.009932] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.010984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.011083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.011291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.011383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.011479] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.032022] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.032022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.032022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.032022] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.340281] env[69238]: INFO networking_nsxv3.common.synchronization [req-2b287500-5351-4b44-bc8d-2299b5ccc5e5 req-acdd8746-a8b6-4add-bfe0-539afec90917 tempest-ServerAddressesNegativeTestJSON-1663110117 tempest-ServerAddressesNegativeTestJSON-1663110117-project-member] Enqueued Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_members [ 1000.340281] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_members [ 1000.340281] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.340281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.340281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.342560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.342878] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.343168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.343223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.343468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.343638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.343818] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.514559] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.517260] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.517260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.517260] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be updated. [ 1000.539038] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.539038] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.539038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.539624] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.539624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.539733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.540108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.540108] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.540252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.540252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.540831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.540831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.540831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.540831] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.550017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.550229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.550323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.550573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.550721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.561319] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: IN_PROGRESS for 2s [ 1000.775920] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.776967] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-314" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.776967] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-314" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.776967] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-314" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.776967] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.777268] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.777268] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.779019] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.779019] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.779019] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.779019] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.779019] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.779019] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.779019] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.779019] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.779019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.800382] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.800628] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.800728] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.800913] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-314" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.801294] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-f78e9bfa-ebe1-4696-9042-a8979ebd233c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.801465] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.801619] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.801957] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.802117] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f78e9bfa-ebe1-4696-9042-a8979ebd233c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.846923] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.846923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.846923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.847097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.847185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.847363] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.847471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.847528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.847661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.847752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.851031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e already deleted. [ 1000.851031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.043806] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1001.068909] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.069082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.069154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.069433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.069526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.069741] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.069863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.069926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.070099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.070175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.070396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.070490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.070603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.070727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.070818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.071020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.072402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.072512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.072614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.072714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.072860] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be created. [ 1001.142009] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.142187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.142228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.145774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.145774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.156099] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1001.308037] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.308037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.308037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.308037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.308037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.308037] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port f78e9bfa-ebe1-4696-9042-a8979ebd233c not found, creating... [ 1001.308037] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.308037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.308781] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.309413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.309768] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.310487] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.310889] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.311338] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.311794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.312071] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.312422] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: f78e9bfa-ebe1-4696-9042-a8979ebd233c is going to be created. [ 1001.340078] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.340078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.340078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.340078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.340078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.340078] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.974093] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b8b05182-49e5-49a6-9846-06672fb020da None None] Enqueued Resource ID: 7c2a727d-2a41-41bb-93df-e86054ca7ae9 with Priority: HIGHEST for action port [ 1001.974093] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2a727d-2a41-41bb-93df-e86054ca7ae9 with Priority: HIGHEST for action port [ 1001.974093] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c2a727d-2a41-41bb-93df-e86054ca7ae9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.974093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c2a727d-2a41-41bb-93df-e86054ca7ae9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.974093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c2a727d-2a41-41bb-93df-e86054ca7ae9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.974356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c2a727d-2a41-41bb-93df-e86054ca7ae9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.974356] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2a727d-2a41-41bb-93df-e86054ca7ae9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.119445] env[69238]: INFO networking_nsxv3.common.synchronization [req-2b287500-5351-4b44-bc8d-2299b5ccc5e5 req-6960bd87-e63e-49c2-a5b7-b3466b6f0608 service nova] Enqueued Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_rules [ 1002.119642] env[69238]: INFO networking_nsxv3.common.synchronization [req-2b287500-5351-4b44-bc8d-2299b5ccc5e5 req-6960bd87-e63e-49c2-a5b7-b3466b6f0608 service nova] Enqueued Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_members [ 1002.119787] env[69238]: INFO networking_nsxv3.common.synchronization [req-2b287500-5351-4b44-bc8d-2299b5ccc5e5 req-6960bd87-e63e-49c2-a5b7-b3466b6f0608 service nova] Enqueued Resource ID: f78e9bfa-ebe1-4696-9042-a8979ebd233c with Priority: HIGHEST for action port [ 1002.120535] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_rules [ 1002.120674] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_members [ 1002.120819] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78e9bfa-ebe1-4696-9042-a8979ebd233c with Priority: HIGHEST for action port [ 1002.123827] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.124061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.124061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.124980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.125564] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.126515] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.126671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.126763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.126978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.127194] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.127328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.127415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.127594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.127709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.127830] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.128744] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f78e9bfa-ebe1-4696-9042-a8979ebd233c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.128874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.128966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.129155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.129301] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f78e9bfa-ebe1-4696-9042-a8979ebd233c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.476592] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c2a727d-2a41-41bb-93df-e86054ca7ae9 [ 1002.477036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.477036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.477146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.477334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.477430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.477526] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c2a727d-2a41-41bb-93df-e86054ca7ae9 already deleted. [ 1002.477604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c2a727d-2a41-41bb-93df-e86054ca7ae9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.575627] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f in Status: SUCCESS [ 1002.575832] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f deletion is rescheduled due to dependency. [ 1002.575951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.630793] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.630955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.631382] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.635445] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f78e9bfa-ebe1-4696-9042-a8979ebd233c with status ACTIVE [ 1002.635604] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.636093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.636256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.636537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.636765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.637057] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.637254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.637337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.637533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.637876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.637876] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.637999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.637999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.638156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.638231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.638330] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f78e9bfa-ebe1-4696-9042-a8979ebd233c is going to be updated. [ 1002.666342] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.667168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.667409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.667708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.667973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.668260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f78e9bfa-ebe1-4696-9042-a8979ebd233c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.136679] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.168519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1003.168888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.639506] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.639506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.639506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.639506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.639506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.639506] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e is going to be created. [ 1003.663152] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.663457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.663554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.663761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.663922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.674426] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e in Status: UNINITIALIZED for 2s [ 1004.840092] env[69238]: INFO networking_nsxv3.common.synchronization [req-d897c1cc-e0d4-481a-8696-e2b08002ce6b req-9d5bdea6-079c-4a70-a975-323d3aa92613 tempest-ServersNegativeTestJSON-1827147972 tempest-ServersNegativeTestJSON-1827147972-project-member] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 1004.840604] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 1004.840980] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.841363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.842441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.842591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.842986] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.843159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.843255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.844164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.844286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.844562] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.251632] env[69238]: INFO networking_nsxv3.common.synchronization [None req-24ee1784-c96c-4c6f-b403-da4318a5cc9b tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_rules [ 1005.252234] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_rules [ 1005.252559] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.252675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.252736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.254180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.254180] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.349460] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.418102] env[69238]: INFO networking_nsxv3.common.synchronization [None req-7e55ae1d-5e35-49e0-8fbe-3c4ff22ea7aa tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_rules [ 1005.418765] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_rules [ 1005.419277] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.419277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.690741] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e in Status: SUCCESS [ 1005.691036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.691241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.691511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.691782] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.691947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.692041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.692250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.692338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.692453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.692561] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.782466] env[69238]: INFO networking_nsxv3.common.synchronization [req-ba951c48-9aab-46ca-a59f-19285ec67888 req-58eaaf90-850a-4f73-b1eb-4d497d43d1ea tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_members [ 1005.783494] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.783616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.783687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.783887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.783978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.786593] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 already deleted. [ 1005.786704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.787247] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_members [ 1005.787422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.787606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.787696] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.788644] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.788779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.788823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.789058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.789215] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.789314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.789404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.789549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.789629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.789720] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.851953] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.199189] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.199386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.199462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.199758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.199892] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.200033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.200068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.200229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.200313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.200400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.200579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.200685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.200762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.200908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.201065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.201160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.201211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.201398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.201511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.201623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.201734] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.299108] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.299108] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.299108] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee already deleted. [ 1006.299108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.317538] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.317538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.317538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.317538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.317538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.317538] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 already deleted. [ 1006.317538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.355036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.358298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.358298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.358298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.358298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.358298] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be updated. [ 1006.389333] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.390034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.390034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.390034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.390034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.399288] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 1006.484022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.484022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.484022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.484022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.484289] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.484289] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.484373] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.484557] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.484724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.484911] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.485036] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.485148] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.485260] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.485388] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.485506] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.485642] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.505415] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.505612] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.505801] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.506038] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.506399] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.506592] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.506726] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.507117] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.507271] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b3704f-2f9f-4084-94ea-b4dc49c86aaf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.705329] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc8f1ded-72b4-4b3d-86f9-3cc1338a788e: rpc.has_security_group_logging(os_id): False [ 1006.725748] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.725748] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.725748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.725748] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.726215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.726215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.727037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.727037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.727037] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.727037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.727037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.727037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.727037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.727733] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e is going to be created. [ 1006.786263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.786414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.786584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.786834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.787037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.815359] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e in Status: IN_PROGRESS for 2s [ 1007.010629] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.010629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.010629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.010629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.010629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.010629] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 38b3704f-2f9f-4084-94ea-b4dc49c86aaf not found, creating... [ 1007.011167] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.011167] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.011247] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.011449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.011599] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.013588] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.013588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.013588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.013588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.013588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.013588] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 38b3704f-2f9f-4084-94ea-b4dc49c86aaf is going to be created. [ 1007.036314] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.036553] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.036696] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.036975] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.037239] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.037562] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.183339] env[69238]: INFO networking_nsxv3.common.synchronization [req-f3c48779-d0af-456e-afd1-337a52aee4ee req-c74a8c8c-cbec-4885-a924-879cc8274249 tempest-ServersWithSpecificFlavorTestJSON-1275212292 tempest-ServersWithSpecificFlavorTestJSON-1275212292-project-member] Enqueued Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 1007.184346] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 with Priority: HIGHEST for action security_group_members [ 1007.184666] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b0ebb8-e601-44fa-aac4-0c8f25377737 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.186272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.186923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.187203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.187566] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.187727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.187799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.187978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.188085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.188184] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b0ebb8-e601-44fa-aac4-0c8f25377737',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.693366] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.694795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.694878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.695746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.695746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.695746] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.695746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.695746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.696031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.696031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.696031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 is going to be updated. [ 1007.732120] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.732668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.732668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.732806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.733093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.745524] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: IN_PROGRESS for 2s [ 1007.943091] env[69238]: INFO networking_nsxv3.common.synchronization [req-ba951c48-9aab-46ca-a59f-19285ec67888 req-74a58f14-dfd4-4dc2-a26e-03540db46390 service nova] Enqueued Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_rules [ 1007.943307] env[69238]: INFO networking_nsxv3.common.synchronization [req-ba951c48-9aab-46ca-a59f-19285ec67888 req-74a58f14-dfd4-4dc2-a26e-03540db46390 service nova] Enqueued Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_members [ 1007.944412] env[69238]: INFO networking_nsxv3.common.synchronization [req-ba951c48-9aab-46ca-a59f-19285ec67888 req-74a58f14-dfd4-4dc2-a26e-03540db46390 service nova] Enqueued Resource ID: 38b3704f-2f9f-4084-94ea-b4dc49c86aaf with Priority: HIGHEST for action port [ 1007.944412] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_rules [ 1007.944412] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_members [ 1007.944412] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b3704f-2f9f-4084-94ea-b4dc49c86aaf with Priority: HIGHEST for action port [ 1007.944615] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.944676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.944725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.944908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.944981] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.948290] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.948416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.948479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.948675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.948831] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.948931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.948998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.949149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.949235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.949328] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.950246] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.954024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.954024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.954024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.954024] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b3704f-2f9f-4084-94ea-b4dc49c86aaf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.417578] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 1008.417857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.454469] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.454648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.454871] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.455852] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38b3704f-2f9f-4084-94ea-b4dc49c86aaf with status ACTIVE [ 1008.456128] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.456296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.456391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.456621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.456754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.456942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.457074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.457155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.457375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.457489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.457708] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.457842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.457923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.458203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.458305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.458418] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38b3704f-2f9f-4084-94ea-b4dc49c86aaf is going to be updated. [ 1008.484523] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.484523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.484523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.484523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.484523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.484523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38b3704f-2f9f-4084-94ea-b4dc49c86aaf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.828450] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e in Status: SUCCESS [ 1008.828450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.961241] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.464324] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.464672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.464672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.464794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.464892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.464996] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee is going to be created. [ 1009.490064] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.491116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.491116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.491116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.491116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.505872] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee in Status: UNINITIALIZED for 2s [ 1009.757749] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 in Status: SUCCESS [ 1009.758123] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b0ebb8-e601-44fa-aac4-0c8f25377737 deletion is rescheduled due to dependency. [ 1009.758208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b0ebb8-e601-44fa-aac4-0c8f25377737" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.407535] env[69238]: INFO networking_nsxv3.common.synchronization [req-92d26082-514d-43ea-a3a7-c275c0b1866e req-ec9b6f81-ce0f-46e9-b9ea-2cbef2cffee8 tempest-ServerPasswordTestJSON-2075301162 tempest-ServerPasswordTestJSON-2075301162-project-member] Enqueued Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_members [ 1010.408137] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_members [ 1010.409042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.409200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.409264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.409847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.409947] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.410023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.410118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.410284] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.410440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.410440] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.913862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.914399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.914399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.914399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.914399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.914697] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.914876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.914876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.915026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.915109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.915195] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 already deleted. [ 1010.915278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.917374] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.917594] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-848" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.917723] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-848" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.918076] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-848" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.918353] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.918601] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.918646] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.918867] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.919046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.919537] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.919537] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.919602] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.919748] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.919871] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.919983] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.920140] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.949723] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.949877] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.950042] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.950232] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-848" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.950614] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.950826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.950955] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.951461] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.951461] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0526b770-9f8b-46f0-b99b-c8c5442f7fd9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.455800] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.455800] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.455800] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.456482] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.458424] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.458424] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 0526b770-9f8b-46f0-b99b-c8c5442f7fd9 not found, creating... [ 1011.458424] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.458424] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.458424] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.458424] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.458424] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.458424] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.458424] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.459143] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.459509] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.459795] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.460105] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 0526b770-9f8b-46f0-b99b-c8c5442f7fd9 is going to be created. [ 1011.488689] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.488689] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.489733] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.489733] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.489733] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.489995] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.516563] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee in Status: SUCCESS [ 1011.516813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.517114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.517473] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.517711] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.517892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.518035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.518275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.518475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.518626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.518764] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.022691] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.191878] env[69238]: INFO networking_nsxv3.common.synchronization [req-92d26082-514d-43ea-a3a7-c275c0b1866e req-e8ff95ba-2447-4fe7-baed-8b38082e70db service nova] Enqueued Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_rules [ 1012.191878] env[69238]: INFO networking_nsxv3.common.synchronization [req-92d26082-514d-43ea-a3a7-c275c0b1866e req-e8ff95ba-2447-4fe7-baed-8b38082e70db service nova] Enqueued Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_members [ 1012.191878] env[69238]: INFO networking_nsxv3.common.synchronization [req-92d26082-514d-43ea-a3a7-c275c0b1866e req-e8ff95ba-2447-4fe7-baed-8b38082e70db service nova] Enqueued Resource ID: 0526b770-9f8b-46f0-b99b-c8c5442f7fd9 with Priority: HIGHEST for action port [ 1012.191878] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_rules [ 1012.191878] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_members [ 1012.191878] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0526b770-9f8b-46f0-b99b-c8c5442f7fd9 with Priority: HIGHEST for action port [ 1012.192964] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.193318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.193492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.193832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.194105] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.197021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.197021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.197021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.197021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.197021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.197021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.197021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.197021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.197021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.197021] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.197021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.197969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.198231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.198477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.199101] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0526b770-9f8b-46f0-b99b-c8c5442f7fd9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.524170] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a29c175-5acc-4d5c-b7f6-b89ab43280ee: rpc.has_security_group_logging(os_id): False [ 1012.547363] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.547363] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.547363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.547363] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee is going to be created. [ 1012.609488] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.609788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.609899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.610301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.610600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.623353] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee in Status: IN_PROGRESS for 2s [ 1012.701156] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.701368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.701637] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.702840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0526b770-9f8b-46f0-b99b-c8c5442f7fd9 with status ACTIVE [ 1012.703031] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.703173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.703243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.703477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.703607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.703784] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.703902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.703956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.705676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.706039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.706248] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.706370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.706475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.706683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.706743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.706971] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0526b770-9f8b-46f0-b99b-c8c5442f7fd9 is going to be updated. [ 1012.736600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.736763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.736873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.737122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.737332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.737832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0526b770-9f8b-46f0-b99b-c8c5442f7fd9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.183597] env[69238]: INFO networking_nsxv3.common.synchronization [req-22d3418b-a896-4b5d-9d8c-88b431fc1e14 req-26588070-813f-4c04-b13a-88532d6c07bd tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1013.184208] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1013.184511] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.184634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.185271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.185271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.185271] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.185271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.185271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.185533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.185533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.185533] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.209621] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.291313] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c0139382-b689-4f3f-9f99-0f10d52da496 None None] Enqueued Resource ID: 5b88de53-77c5-4849-a75b-c84fbf7d6c82 with Priority: HIGHEST for action port [ 1013.296421] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b88de53-77c5-4849-a75b-c84fbf7d6c82 with Priority: HIGHEST for action port [ 1013.296860] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b88de53-77c5-4849-a75b-c84fbf7d6c82 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.297017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b88de53-77c5-4849-a75b-c84fbf7d6c82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.297106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b88de53-77c5-4849-a75b-c84fbf7d6c82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.297408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b88de53-77c5-4849-a75b-c84fbf7d6c82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.297517] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b88de53-77c5-4849-a75b-c84fbf7d6c82',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.528138] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.528138] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.528138] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.529595] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.532468] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.532468] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.532468] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.532468] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.532468] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.532468] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.532468] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.532468] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.532468] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.533488] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.533870] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.534262] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.556904] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.557197] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.557422] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.557797] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.558348] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-19b64075-3dd5-4fcf-802f-cffc88812b79 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.560288] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.560589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.561541] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.561857] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19b64075-3dd5-4fcf-802f-cffc88812b79',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.687797] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.688009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.688120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.688384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.688502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.688703] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.688803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.688867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.689029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.689155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.689269] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 1013.713207] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.713207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.713207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.713711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.713711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.713711] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 is going to be created. [ 1013.716058] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.716864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.716987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.717211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.717356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.731635] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1013.745210] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.745210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.745210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.745210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.745210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.753853] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 in Status: UNINITIALIZED for 2s [ 1013.800423] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b88de53-77c5-4849-a75b-c84fbf7d6c82 [ 1013.800423] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.800423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.800423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.800423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.800423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.800423] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b88de53-77c5-4849-a75b-c84fbf7d6c82 already deleted. [ 1013.800423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b88de53-77c5-4849-a75b-c84fbf7d6c82" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.065888] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.066140] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.066275] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.066604] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.066758] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.066920] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 19b64075-3dd5-4fcf-802f-cffc88812b79 not found, creating... [ 1014.067227] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.067596] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.067596] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.067839] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.068026] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.068314] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.068476] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.068602] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.068823] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.068964] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.069138] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 19b64075-3dd5-4fcf-802f-cffc88812b79 is going to be created. [ 1014.091688] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.091981] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.092105] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.092378] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.092685] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.092940] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.641277] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee in Status: SUCCESS [ 1014.641662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.664402] env[69238]: INFO networking_nsxv3.common.synchronization [None req-cbfe331c-7ec9-4eb3-97c2-1987590d86ca tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_rules [ 1014.664595] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_rules [ 1014.664894] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.665037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.665100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.665344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.665421] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.670320] env[69238]: INFO networking_nsxv3.common.synchronization [req-ab9b1156-1617-4c33-a068-92b84b78bd77 req-ae757474-5d03-4402-96f0-130fd03ca387 tempest-ServerAddressesNegativeTestJSON-1663110117 tempest-ServerAddressesNegativeTestJSON-1663110117-project-member] Enqueued Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_members [ 1014.674598] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e with Priority: HIGHEST for action security_group_members [ 1014.674931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.675066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.675135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.675331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.675482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.675577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.675638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.676577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.676577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.676577] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc8f1ded-72b4-4b3d-86f9-3cc1338a788e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.849371] env[69238]: INFO networking_nsxv3.common.synchronization [None req-aa5673ef-3bbe-4f8a-841f-9d4c97cdea61 tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_rules [ 1014.850086] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_rules [ 1014.850400] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.850517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.930138] env[69238]: INFO networking_nsxv3.common.synchronization [req-22d3418b-a896-4b5d-9d8c-88b431fc1e14 req-f2c6ad00-6f30-494f-afca-7b5b856a120f service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 1014.930321] env[69238]: INFO networking_nsxv3.common.synchronization [req-22d3418b-a896-4b5d-9d8c-88b431fc1e14 req-f2c6ad00-6f30-494f-afca-7b5b856a120f service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1014.930469] env[69238]: INFO networking_nsxv3.common.synchronization [req-22d3418b-a896-4b5d-9d8c-88b431fc1e14 req-f2c6ad00-6f30-494f-afca-7b5b856a120f service nova] Enqueued Resource ID: 19b64075-3dd5-4fcf-802f-cffc88812b79 with Priority: HIGHEST for action port [ 1014.933344] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 1014.933344] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1014.933344] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19b64075-3dd5-4fcf-802f-cffc88812b79 with Priority: HIGHEST for action port [ 1014.933344] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.933344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.933344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.933344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.933344] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.935310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.935310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.935310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-19b64075-3dd5-4fcf-802f-cffc88812b79 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.935310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.935310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.935310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.935310] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19b64075-3dd5-4fcf-802f-cffc88812b79',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.179750] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.181119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.181119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.181211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.181259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.181457] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.181542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.181594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.181743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.181817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.181898] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e is going to be updated. [ 1015.189719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.189985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.190055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.190344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.190504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.190648] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c767742c-a318-4de7-875d-b9006231b601 already deleted. [ 1015.190803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.191069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.191283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.191446] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.230899] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.231195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.231195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.231317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.231421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.243960] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e in Status: IN_PROGRESS for 2s [ 1015.437366] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.437366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.443313] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19b64075-3dd5-4fcf-802f-cffc88812b79 with status ACTIVE [ 1015.443313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.443313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.443313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.443313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.443313] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19b64075-3dd5-4fcf-802f-cffc88812b79 is going to be updated. [ 1015.468430] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.468603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.468732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.468874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.469033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.469208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19b64075-3dd5-4fcf-802f-cffc88812b79" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.729115] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.729529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.729590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.729874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.730112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.730112] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c767742c-a318-4de7-875d-b9006231b601 already deleted. [ 1015.730230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.747010] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1015.747218] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c deletion is rescheduled due to dependency. [ 1015.747390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.747581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.747807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.747996] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.748124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.748188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.748345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.748430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.748527] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.768452] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 in Status: SUCCESS [ 1015.768842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.769261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.769478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.769759] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.769883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.769947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.770140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.770229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.770313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.770408] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.083227] env[69238]: INFO networking_nsxv3.common.synchronization [None req-683cc208-3e30-4f04-a518-dbd8c602f78f None None] Enqueued Resource ID: a7b64c8a-fd5a-4bd0-8d92-e2e430331481 with Priority: HIGHEST for action port [ 1016.083579] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b64c8a-fd5a-4bd0-8d92-e2e430331481 with Priority: HIGHEST for action port [ 1016.084065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7b64c8a-fd5a-4bd0-8d92-e2e430331481 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.084192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7b64c8a-fd5a-4bd0-8d92-e2e430331481" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.084371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7b64c8a-fd5a-4bd0-8d92-e2e430331481" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.084497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7b64c8a-fd5a-4bd0-8d92-e2e430331481" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.084572] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7b64c8a-fd5a-4bd0-8d92-e2e430331481',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.251914] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.272599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.273113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.273113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.273219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.273303] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.273406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.273471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.273627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.273719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.273804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.274542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.274542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.274542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.274542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.274542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.274542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.274542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.274818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.274818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.274818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.274900] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.590286] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7b64c8a-fd5a-4bd0-8d92-e2e430331481 [ 1016.590286] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.590286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.590286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.590286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.590286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.590578] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7b64c8a-fd5a-4bd0-8d92-e2e430331481 already deleted. [ 1016.590578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7b64c8a-fd5a-4bd0-8d92-e2e430331481" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.755067] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.778387] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dc6e178-f07a-4c39-b3a2-b770f43610e3: rpc.has_security_group_logging(os_id): False [ 1016.797215] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.797384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.797468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.797714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.797839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.798135] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.798292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.798368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.798544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.798631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.798867] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.798965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.799062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.799232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.799363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.799582] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.799661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.799724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.799867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.799942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.800038] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 is going to be created. [ 1016.901246] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.901399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.901510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.901808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.902107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.932067] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 in Status: IN_PROGRESS for 2s [ 1017.253771] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e in Status: SUCCESS [ 1017.253953] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8f1ded-72b4-4b3d-86f9-3cc1338a788e deletion is rescheduled due to dependency. [ 1017.254085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8f1ded-72b4-4b3d-86f9-3cc1338a788e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.256756] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.257059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.257172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.261024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.261024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.261024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 1017.286395] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.286511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.286511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.286703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.286844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.299283] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1018.947504] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 in Status: SUCCESS [ 1018.947838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.308782] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1019.309025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.309192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.309408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.309980] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.309980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.309980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.309980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.310218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.310218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.310281] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.812390] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.315187] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161eb351-451d-49f3-803f-374b4ae2741c: rpc.has_security_group_logging(os_id): False [ 1020.337020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.337020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.337020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.337020] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 1020.396422] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.396574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.396649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.396870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.397048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.416922] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1021.084610] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1021.084723] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1021.274476] env[69238]: INFO networking_nsxv3.common.synchronization [req-af487347-6da9-4773-a3c3-56f0f59132be req-c97d2cd2-aeec-483f-9452-3fa7753aa1c6 tempest-ServerGroupTestJSON-439482577 tempest-ServerGroupTestJSON-439482577-project-member] Enqueued Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_members [ 1021.274476] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_members [ 1021.274476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7aa785-c4cc-4dae-b206-8934232efdf2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.274476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.274476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.274476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.274476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.274476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.275288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.276057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.276057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.276057] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.646079] env[69238]: INFO networking_nsxv3.common.synchronization [None req-5c7f87ea-91dc-46df-b5c5-a53f624fc22d None None] Enqueued Resource ID: b86b339b-e2c7-4173-b7b9-75004490c934 with Priority: HIGHEST for action port [ 1021.646832] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86b339b-e2c7-4173-b7b9-75004490c934 with Priority: HIGHEST for action port [ 1021.647271] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-b86b339b-e2c7-4173-b7b9-75004490c934 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.647360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b86b339b-e2c7-4173-b7b9-75004490c934" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.647410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b86b339b-e2c7-4173-b7b9-75004490c934" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.647668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b86b339b-e2c7-4173-b7b9-75004490c934" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.647762] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b86b339b-e2c7-4173-b7b9-75004490c934',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.780396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.780661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.780776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.781122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.781248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.781570] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.781739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.781845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.782116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.782248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.782384] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 already deleted. [ 1021.782514] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.150711] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b86b339b-e2c7-4173-b7b9-75004490c934 [ 1022.151108] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.151313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.151313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.151504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.151504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.151665] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b86b339b-e2c7-4173-b7b9-75004490c934 already deleted. [ 1022.151665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b86b339b-e2c7-4173-b7b9-75004490c934" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.209783] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.210397] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-162" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.210614] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-162" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.211098] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-162" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.211436] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.211645] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.211811] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.212135] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.213651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.213651] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.213651] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.213651] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.213651] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.213651] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.213651] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.213651] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.241028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.241218] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.241351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.242812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-162" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.242812] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-220cde06-103e-402b-afbb-4cac0b049717 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.242812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.242812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.242812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.242812] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('220cde06-103e-402b-afbb-4cac0b049717',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.433525] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1022.433525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.749341] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.749341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.749341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.749341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.749341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.749341] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 220cde06-103e-402b-afbb-4cac0b049717 not found, creating... [ 1022.749341] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.749341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.749341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.749341] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.750094] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.750094] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.750094] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.751213] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.751616] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.751835] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.752140] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 220cde06-103e-402b-afbb-4cac0b049717 is going to be created. [ 1022.774823] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.775056] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.775192] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.775481] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.775741] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.776707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.526903] env[69238]: INFO networking_nsxv3.common.synchronization [None req-cd87d5f6-53f9-4c29-9d87-7044a75dd160 None None] Enqueued Resource ID: 67d46780-8850-4340-95a3-7903bd746793 with Priority: HIGHEST for action port [ 1023.527270] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d46780-8850-4340-95a3-7903bd746793 with Priority: HIGHEST for action port [ 1023.528177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d46780-8850-4340-95a3-7903bd746793 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.528177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d46780-8850-4340-95a3-7903bd746793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.528177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d46780-8850-4340-95a3-7903bd746793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.528448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d46780-8850-4340-95a3-7903bd746793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.528448] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d46780-8850-4340-95a3-7903bd746793',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.687823] env[69238]: INFO networking_nsxv3.common.synchronization [req-af487347-6da9-4773-a3c3-56f0f59132be req-ea030f13-8005-47b4-8450-e6b61692cd77 service nova] Enqueued Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_rules [ 1023.688567] env[69238]: INFO networking_nsxv3.common.synchronization [req-af487347-6da9-4773-a3c3-56f0f59132be req-ea030f13-8005-47b4-8450-e6b61692cd77 service nova] Enqueued Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_members [ 1023.688567] env[69238]: INFO networking_nsxv3.common.synchronization [req-af487347-6da9-4773-a3c3-56f0f59132be req-ea030f13-8005-47b4-8450-e6b61692cd77 service nova] Enqueued Resource ID: 220cde06-103e-402b-afbb-4cac0b049717 with Priority: HIGHEST for action port [ 1023.688712] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_rules [ 1023.688851] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_members [ 1023.688947] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220cde06-103e-402b-afbb-4cac0b049717 with Priority: HIGHEST for action port [ 1023.689927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa7aa785-c4cc-4dae-b206-8934232efdf2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.690155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.690155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.690493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.690585] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.691520] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7aa785-c4cc-4dae-b206-8934232efdf2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.691613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.691689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.691845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.692616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.692737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.692801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.692964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.693066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.693169] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.694656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-220cde06-103e-402b-afbb-4cac0b049717 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.694656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.694656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.694865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.694865] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('220cde06-103e-402b-afbb-4cac0b049717',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.034368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67d46780-8850-4340-95a3-7903bd746793 [ 1024.034368] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.034368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.034368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.034368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.034368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.034368] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67d46780-8850-4340-95a3-7903bd746793 already deleted. [ 1024.034368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d46780-8850-4340-95a3-7903bd746793" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.201435] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.202801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7aa785-c4cc-4dae-b206-8934232efdf2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.206160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.207282] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 220cde06-103e-402b-afbb-4cac0b049717 with status ACTIVE [ 1024.207282] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.207282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.207282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.207282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.207540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.207591] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.207721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.207963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.208828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.208828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.208828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.208828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.208828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.208828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.209106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.209106] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 220cde06-103e-402b-afbb-4cac0b049717 is going to be updated. [ 1024.234516] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.234516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.234516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.234516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.234516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.234516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-220cde06-103e-402b-afbb-4cac0b049717" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.290976] env[69238]: INFO networking_nsxv3.common.synchronization [None req-bd0a7138-4cd3-4fc2-9071-6ef8f39c7107 None None] Enqueued Resource ID: a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c with Priority: HIGHEST for action port [ 1024.291263] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c with Priority: HIGHEST for action port [ 1024.291815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.291940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.292034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.292261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.292342] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.707821] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.795413] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c [ 1024.795647] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.795822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.795904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.796128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.796216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.796312] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c already deleted. [ 1024.796394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a09f12dd-3e8f-47b8-8c9e-6793b6a9f50c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.209799] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.210108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.210108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.210283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.210371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.210470] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 is going to be created. [ 1025.238984] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.239160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.239232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.239471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.239614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.250713] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 in Status: UNINITIALIZED for 2s [ 1025.482861] env[69238]: INFO networking_nsxv3.common.synchronization [None req-32c2f543-3737-48b1-976a-f16ac4933c8c None None] Enqueued Resource ID: 9e8e0115-8b71-4ea9-9175-c1a2588d3401 with Priority: HIGHEST for action port [ 1025.483504] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e8e0115-8b71-4ea9-9175-c1a2588d3401 with Priority: HIGHEST for action port [ 1025.483826] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e8e0115-8b71-4ea9-9175-c1a2588d3401 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.483942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e8e0115-8b71-4ea9-9175-c1a2588d3401" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.484191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e8e0115-8b71-4ea9-9175-c1a2588d3401" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.487897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e8e0115-8b71-4ea9-9175-c1a2588d3401" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.488037] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e8e0115-8b71-4ea9-9175-c1a2588d3401',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.990788] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e8e0115-8b71-4ea9-9175-c1a2588d3401 [ 1025.990980] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.991146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.991307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.991475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.991532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.991595] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e8e0115-8b71-4ea9-9175-c1a2588d3401 already deleted. [ 1025.991674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e8e0115-8b71-4ea9-9175-c1a2588d3401" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.111027] env[69238]: INFO networking_nsxv3.common.synchronization [req-61bc1d69-f3c9-4974-bd89-a2c1661aa748 req-8e883ee0-697f-42a4-99c3-cfc703fcfbe2 tempest-VolumesAdminNegativeTest-1660961456 tempest-VolumesAdminNegativeTest-1660961456-project-member] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_members [ 1027.115073] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGHEST for action security_group_members [ 1027.115073] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.115073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.115073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.115073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.115073] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.115073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.115073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.115073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.115073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.115073] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.263774] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 in Status: SUCCESS [ 1027.263774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.264064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.264293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.264487] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.264770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.264770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.265201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.265460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.265460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.265598] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.469409] env[69238]: INFO networking_nsxv3.common.synchronization [req-2719b548-c49d-482d-b4dd-df608e5475ba req-0e1bb87a-5191-45dd-b07a-07bc35209f8a tempest-ServerPasswordTestJSON-2075301162 tempest-ServerPasswordTestJSON-2075301162-project-member] Enqueued Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_members [ 1027.469975] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGHEST for action security_group_members [ 1027.470539] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.470539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.470539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.470711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.470827] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.470930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.470993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.471343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.471436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.471533] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.617886] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.618043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.618043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.618254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.618343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.618539] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.618629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.618687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.618830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.619238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.619367] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23d3814-f79b-4992-979c-27687860c2ee is going to be updated. [ 1027.653540] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.653708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.653781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.653992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.654159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.664015] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: IN_PROGRESS for 2s [ 1027.776819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7aa785-c4cc-4dae-b206-8934232efdf2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.776819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.776819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.776819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7aa785-c4cc-4dae-b206-8934232efdf2 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.777563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.777754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.778020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.778292] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.778502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.778702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.778949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.779140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.779313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.779493] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.975142] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.975345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.975404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.975593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.975687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.975885] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.975982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.976060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.976201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.976277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.976363] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 is going to be updated. [ 1028.005527] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.005682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.005747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.005956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.006105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.016572] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 in Status: IN_PROGRESS for 2s [ 1028.051868] env[69238]: INFO networking_nsxv3.common.synchronization [req-c4f6483e-69b7-4064-b0a2-507f292bce12 req-acf2c844-55a0-4277-b7e0-b2486c143182 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1028.052991] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1028.052991] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.053174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.053208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.053453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.053607] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.054106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.054106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.054106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.054106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.054106] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.282182] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa7aa785-c4cc-4dae-b206-8934232efdf2: rpc.has_security_group_logging(os_id): False [ 1028.306030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.306030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.306030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.306030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.307022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.307393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.307681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.308568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.308774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.308998] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 is going to be created. [ 1028.377104] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.377104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.377104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.377104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.377104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.389683] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 in Status: IN_PROGRESS for 2s [ 1028.561402] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.561402] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.561402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.561402] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 already deleted. [ 1028.563028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.838148] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.838148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-758" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.838148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-758" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.838148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-758" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.838148] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.838148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.838148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.838785] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.839119] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.839469] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.839730] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.840013] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.840281] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.840526] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.840765] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.841084] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.865425] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.866453] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1028.866453] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.866885] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-758" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.867834] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-4e59bd35-0028-4167-b18d-84ff4346a0f6 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.867834] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.867834] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.868110] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.868150] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e59bd35-0028-4167-b18d-84ff4346a0f6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.373749] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.373749] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.373749] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.373749] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.373749] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.373749] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 4e59bd35-0028-4167-b18d-84ff4346a0f6 not found, creating... [ 1029.374302] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.374302] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.374302] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.374417] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.374583] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.374919] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.375125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.375263] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.375506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.375673] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.375842] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 is going to be created. [ 1029.397774] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.399046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.399046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.399046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.399046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.399046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.674121] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23d3814-f79b-4992-979c-27687860c2ee in Status: SUCCESS [ 1029.674398] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23d3814-f79b-4992-979c-27687860c2ee deletion is rescheduled due to dependency. [ 1029.674633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.026891] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 in Status: SUCCESS [ 1030.027096] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 deletion is rescheduled due to dependency. [ 1030.027215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.259785] env[69238]: INFO networking_nsxv3.common.synchronization [req-c4f6483e-69b7-4064-b0a2-507f292bce12 req-81f9e1dd-f589-4963-9e08-954aff0c7030 service nova] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_rules [ 1030.260047] env[69238]: INFO networking_nsxv3.common.synchronization [req-c4f6483e-69b7-4064-b0a2-507f292bce12 req-81f9e1dd-f589-4963-9e08-954aff0c7030 service nova] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1030.260191] env[69238]: INFO networking_nsxv3.common.synchronization [req-c4f6483e-69b7-4064-b0a2-507f292bce12 req-81f9e1dd-f589-4963-9e08-954aff0c7030 service nova] Enqueued Resource ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 with Priority: HIGHEST for action port [ 1030.260841] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_rules [ 1030.261018] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1030.267416] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 with Priority: HIGHEST for action port [ 1030.267416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.267416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.267416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.267416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.267416] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.267416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.267718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.267718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.267807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.267927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.268014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.268067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.268236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.268324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.268416] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.272242] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e59bd35-0028-4167-b18d-84ff4346a0f6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.272242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.272242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.272242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.272242] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e59bd35-0028-4167-b18d-84ff4346a0f6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.402494] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 in Status: SUCCESS [ 1030.402494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.774639] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.774971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.775137] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.776169] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e59bd35-0028-4167-b18d-84ff4346a0f6 with status ACTIVE [ 1030.776362] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.776509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.776588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.776813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.776925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.777135] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.777244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.777286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.777429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.778094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.778339] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.778455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.778542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.778854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.778941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.779041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 is going to be updated. [ 1030.803772] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.804040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.804134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.804351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.804502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.804666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.283740] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.785978] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.786405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.786405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.786483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.786605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.786679] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be created. [ 1031.812645] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.812948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.813070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.813323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.813496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.944052] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: UNINITIALIZED for 2s [ 1033.957798] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1033.958238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.958531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.958843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.959153] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.959307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.959408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.959745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.959792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.959891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.964743] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.071674] env[69238]: INFO networking_nsxv3.common.synchronization [req-8a9c1ea0-74a0-4fa0-9b44-d947a3ddbd37 req-7c2d6a0a-37a1-475e-b14d-a11278cdf239 tempest-ServerGroupTestJSON-439482577 tempest-ServerGroupTestJSON-439482577-project-member] Enqueued Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_members [ 1034.075577] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 with Priority: HIGHEST for action security_group_members [ 1034.076782] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa7aa785-c4cc-4dae-b206-8934232efdf2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.076782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.076782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.076782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.076782] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.076782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.077065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.078140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.078267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.078401] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa7aa785-c4cc-4dae-b206-8934232efdf2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.468169] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.468329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.468401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.468622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.469556] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.469556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.469556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.469790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.469790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.469790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.470174] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.470174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.470174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.470827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.470827] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.470827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.470827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.470827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.470827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.470827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.471210] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.581801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.581973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.581973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.582155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.582255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.582448] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.582549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.582613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.582763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.583718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.583718] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 is going to be updated. [ 1034.616838] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.616989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.617076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.617424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.617424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.629300] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 in Status: IN_PROGRESS for 2s [ 1034.973892] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a42013c-f7b7-4df2-92c5-c960a9c82f77: rpc.has_security_group_logging(os_id): False [ 1034.992127] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.992313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.992373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.992595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.992691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.992885] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.992988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.993047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.993196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.993288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.993499] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.993599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.993651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.993789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.993860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.998088] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.998249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.998323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.998480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.998561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.998651] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be created. [ 1035.070445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.070445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.070445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.070445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.070445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.079760] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: IN_PROGRESS for 2s [ 1036.640027] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 in Status: SUCCESS [ 1036.640379] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa7aa785-c4cc-4dae-b206-8934232efdf2 deletion is rescheduled due to dependency. [ 1036.640379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa7aa785-c4cc-4dae-b206-8934232efdf2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.093282] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1037.093750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.218540] env[69238]: INFO networking_nsxv3.common.synchronization [req-55b05c58-b85e-40cd-a221-d3b8e9cc6c83 req-c1a36c35-85a1-4b2f-a1f8-ae29d22383d6 tempest-MigrationsAdminTest-400782288 tempest-MigrationsAdminTest-400782288-project-member] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 1037.219698] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 1037.219698] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.219698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.219698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.219698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.219698] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.220060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.220060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.220060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.220157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.220568] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.723022] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.227121] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.494184] env[69238]: INFO networking_nsxv3.common.synchronization [req-50398fea-b140-4635-86bc-1ce429288c50 req-68cebcfb-0a91-4722-ad51-e1ba9795ec15 tempest-ServersNegativeTestMultiTenantJSON-184179782 tempest-ServersNegativeTestMultiTenantJSON-184179782-project-member] Enqueued Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_members [ 1038.494674] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_members [ 1038.494977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-f19e634f-6fff-469e-93a7-10ba29d4b8a8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.495133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.495190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.495945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.497097] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.497097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.497097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.497391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.497391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.497391] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.731018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.731345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.731471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.731721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.731942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.732062] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be updated. [ 1038.762334] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.762513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.762562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.762759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.762905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.771166] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: IN_PROGRESS for 2s [ 1038.804797] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.805011] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-365" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.805156] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-365" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.805853] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-365" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.806472] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.806738] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.806877] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.807159] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.807324] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.807548] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.807666] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.807779] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.807909] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.808068] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.808193] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.808342] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.827843] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.827843] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1038.827843] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.828495] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-365" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.828896] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-c666f2a6-9123-48d7-957a-ce35f95a0795 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.829272] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.829447] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.830403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.830403] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c666f2a6-9123-48d7-957a-ce35f95a0795',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.999290] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.999404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.999445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.000060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.000060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.000060] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.000060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.000283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.000283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.000354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.000417] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 already deleted. [ 1039.000521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.331811] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.332787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.333206] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.333598] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.334225] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.334692] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port c666f2a6-9123-48d7-957a-ce35f95a0795 not found, creating... [ 1039.335396] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.337018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.337018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.337018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.337018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.337018] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.337018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.337018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.337585] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.337849] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.338225] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: c666f2a6-9123-48d7-957a-ce35f95a0795 is going to be created. [ 1039.361632] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.363242] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.364154] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.364385] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.364906] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.364906] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.087837] env[69238]: INFO networking_nsxv3.common.synchronization [req-50398fea-b140-4635-86bc-1ce429288c50 req-d7c146e2-8c41-49fc-90d2-34e28f775eee service nova] Enqueued Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_rules [ 1040.088227] env[69238]: INFO networking_nsxv3.common.synchronization [req-50398fea-b140-4635-86bc-1ce429288c50 req-d7c146e2-8c41-49fc-90d2-34e28f775eee service nova] Enqueued Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_members [ 1040.088304] env[69238]: INFO networking_nsxv3.common.synchronization [req-50398fea-b140-4635-86bc-1ce429288c50 req-d7c146e2-8c41-49fc-90d2-34e28f775eee service nova] Enqueued Resource ID: c666f2a6-9123-48d7-957a-ce35f95a0795 with Priority: HIGHEST for action port [ 1040.088795] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_rules [ 1040.088956] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_members [ 1040.089102] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c666f2a6-9123-48d7-957a-ce35f95a0795 with Priority: HIGHEST for action port [ 1040.089423] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f19e634f-6fff-469e-93a7-10ba29d4b8a8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.089514] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.089585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.089834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.089916] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.090782] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-f19e634f-6fff-469e-93a7-10ba29d4b8a8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.094023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.094023] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.094023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c666f2a6-9123-48d7-957a-ce35f95a0795 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.094023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.094023] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c666f2a6-9123-48d7-957a-ce35f95a0795',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.595065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-f19e634f-6fff-469e-93a7-10ba29d4b8a8 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.595209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.595428] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.596354] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c666f2a6-9123-48d7-957a-ce35f95a0795 with status ACTIVE [ 1040.596538] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.596645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.596713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.596906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.596992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.597174] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.597272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.597334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.597486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.597575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.597732] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.597841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.597875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.598054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.598137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.598226] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c666f2a6-9123-48d7-957a-ce35f95a0795 is going to be updated. [ 1040.619965] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.620250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.620313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.620489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.620625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.620785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c666f2a6-9123-48d7-957a-ce35f95a0795" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.780776] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 1040.781053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.100221] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.604243] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.604413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.604483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.604675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.604762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.604858] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 is going to be created. [ 1041.631657] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.631800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.631857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.632123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.632619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.641957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 in Status: UNINITIALIZED for 2s [ 1043.316876] env[69238]: INFO networking_nsxv3.common.synchronization [req-d58ec5bc-129b-4068-ad49-54f90af7576a req-e40cb0a9-56c4-4aa0-88ca-f85d5048b0c9 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_members [ 1043.318225] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_members [ 1043.318225] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c10bb76f-7801-4c7d-b6c4-3f418c87d789 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.318225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.318375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.318484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.318635] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.318728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.318786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.319703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.319703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.319703] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.605445] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.605445] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.605445] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.605445] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.605445] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.605445] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.605445] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.605839] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.605839] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.606018] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.606077] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.606206] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.606325] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.606446] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.606560] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.606805] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.625964] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.626264] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1043.626373] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.626592] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.626954] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-a2d1600d-e66c-4580-8d42-94462a922528 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.627211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.627324] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.627694] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.627855] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2d1600d-e66c-4580-8d42-94462a922528',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.650909] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 in Status: SUCCESS [ 1043.651185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.651593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.651824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.652046] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.652183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.652257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.652453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.652544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.652639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.652740] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.823307] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.823600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.823744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.824086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.824243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.824471] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.824661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.824661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.824805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.824925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.825044] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 already deleted. [ 1043.825283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.130996] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.130996] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.131256] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.131548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.131905] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.132120] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port a2d1600d-e66c-4580-8d42-94462a922528 not found, creating... [ 1044.132407] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.132576] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.132699] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.132939] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.133107] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.133401] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.133558] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.133678] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.133886] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.134030] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.134175] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: a2d1600d-e66c-4580-8d42-94462a922528 is going to be created. [ 1044.155804] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.156108] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.156257] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.156617] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.156858] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.157108] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.158031] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-f19e634f-6fff-469e-93a7-10ba29d4b8a8 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.158198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.158276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.158456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.158612] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.158707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.158768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.158910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.158987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.159082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.159275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-f19e634f-6fff-469e-93a7-10ba29d4b8a8 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.159395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.159455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.159596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.159736] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.159825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.159884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.160034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.160137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.160215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.160328] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.664527] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f19e634f-6fff-469e-93a7-10ba29d4b8a8: rpc.has_security_group_logging(os_id): False [ 1044.683110] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.683110] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.683110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.683545] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.683545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.683545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.683545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.683545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.683701] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.683752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.683816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.683952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.684159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.684262] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 is going to be created. [ 1044.743411] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.743565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.743646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.743879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.744110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.757335] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 in Status: IN_PROGRESS for 2s [ 1045.000353] env[69238]: INFO networking_nsxv3.common.synchronization [req-d58ec5bc-129b-4068-ad49-54f90af7576a req-da24d1cb-d20f-4a2e-8b54-3298370351f7 service nova] Enqueued Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_rules [ 1045.000544] env[69238]: INFO networking_nsxv3.common.synchronization [req-d58ec5bc-129b-4068-ad49-54f90af7576a req-da24d1cb-d20f-4a2e-8b54-3298370351f7 service nova] Enqueued Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_members [ 1045.000688] env[69238]: INFO networking_nsxv3.common.synchronization [req-d58ec5bc-129b-4068-ad49-54f90af7576a req-da24d1cb-d20f-4a2e-8b54-3298370351f7 service nova] Enqueued Resource ID: a2d1600d-e66c-4580-8d42-94462a922528 with Priority: HIGHEST for action port [ 1045.000920] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_rules [ 1045.001069] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_members [ 1045.001223] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d1600d-e66c-4580-8d42-94462a922528 with Priority: HIGHEST for action port [ 1045.001739] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.001859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.001926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.002134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.002213] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.003016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c10bb76f-7801-4c7d-b6c4-3f418c87d789 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.003133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.003202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.003362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.004243] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.004243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.004243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.004243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.004243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.004488] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.005016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2d1600d-e66c-4580-8d42-94462a922528 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.009201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.009201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.009201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.009201] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2d1600d-e66c-4580-8d42-94462a922528',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.510024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c10bb76f-7801-4c7d-b6c4-3f418c87d789 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.510024] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.510024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2d1600d-e66c-4580-8d42-94462a922528 with status ACTIVE [ 1045.510024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.510024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.510024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.510797] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.510797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.510797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.510797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.510797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.510797] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2d1600d-e66c-4580-8d42-94462a922528 is going to be updated. [ 1045.531791] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.531931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.531976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.532732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.532732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.532732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2d1600d-e66c-4580-8d42-94462a922528" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.012579] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.515409] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.515409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.515409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.515409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.515409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.515615] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 is going to be created. [ 1046.538385] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.538469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.538533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.538738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.538942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.549311] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 in Status: UNINITIALIZED for 2s [ 1046.771170] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 in Status: SUCCESS [ 1046.771450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.470073] env[69238]: INFO networking_nsxv3.common.synchronization [req-bc839a22-c816-4496-ac29-010226b2c2f4 req-abb2864d-4543-4ff2-990a-21cbe3ee1b0f tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1048.470836] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1048.471314] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.471448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.471504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.471693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.471846] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.471928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.471995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.472151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.472227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.472322] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.559442] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 in Status: SUCCESS [ 1048.559657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.560227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.560456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.560648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.560764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.560829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.560982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.561076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.561272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.561272] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.976220] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.063276] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.361508] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.361704] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.361824] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.362146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.362451] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.362651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.363271] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.363271] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.363400] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.363571] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.363711] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.363830] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.363976] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.364114] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.364234] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.364390] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.385185] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.385373] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.385515] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.385851] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.386208] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-e1b5ea8b-761d-467d-806b-5b572f71466f taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.386410] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.386518] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.386855] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.387010] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1b5ea8b-761d-467d-806b-5b572f71466f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.476908] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.569420] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c10bb76f-7801-4c7d-b6c4-3f418c87d789: rpc.has_security_group_logging(os_id): False [ 1049.588942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.589214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.589214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.589668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.589668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.589806] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.589806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.589909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.590010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.590083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.590170] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 is going to be created. [ 1049.656763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.656763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.656763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.656763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.656763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.672273] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 in Status: IN_PROGRESS for 2s [ 1049.889967] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.890264] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.890419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.890852] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.891034] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.891259] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port e1b5ea8b-761d-467d-806b-5b572f71466f not found, creating... [ 1049.891690] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.891971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.891971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.892191] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.892408] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.892811] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.892989] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.893163] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.893474] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.893786] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.893906] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: e1b5ea8b-761d-467d-806b-5b572f71466f is going to be created. [ 1049.919828] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.920075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.920409] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.920628] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.920915] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.921177] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.979162] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.979411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.979411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.979630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.979733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.979811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1050.026849] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.027096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.027212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.027534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.027778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.038853] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1050.306018] env[69238]: INFO networking_nsxv3.common.synchronization [req-4521141c-88f9-409a-9ccc-4febcda99c1c req-4d16e447-130b-4f04-9655-a500498996b6 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_members [ 1050.306018] env[69238]: INFO networking_nsxv3.common.synchronization [req-4521141c-88f9-409a-9ccc-4febcda99c1c req-4d16e447-130b-4f04-9655-a500498996b6 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1050.306018] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_members [ 1050.306018] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1050.306018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb67ab-c436-40df-93c3-37d1a6727527 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.306018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.306018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.306018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.306018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.306018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.306018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.306018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.306018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.306018] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.306788] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.306897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.306960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.307143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.307293] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.307410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.307454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.307587] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.307673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.307766] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.474793] env[69238]: INFO networking_nsxv3.common.synchronization [req-4521141c-88f9-409a-9ccc-4febcda99c1c req-4d16e447-130b-4f04-9655-a500498996b6 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_rules [ 1050.474793] env[69238]: INFO networking_nsxv3.common.synchronization [req-4521141c-88f9-409a-9ccc-4febcda99c1c req-4d16e447-130b-4f04-9655-a500498996b6 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1050.474793] env[69238]: INFO networking_nsxv3.common.synchronization [req-4521141c-88f9-409a-9ccc-4febcda99c1c req-4d16e447-130b-4f04-9655-a500498996b6 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_rules [ 1050.474793] env[69238]: INFO networking_nsxv3.common.synchronization [req-4521141c-88f9-409a-9ccc-4febcda99c1c req-4d16e447-130b-4f04-9655-a500498996b6 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_members [ 1050.474793] env[69238]: INFO networking_nsxv3.common.synchronization [req-4521141c-88f9-409a-9ccc-4febcda99c1c req-4d16e447-130b-4f04-9655-a500498996b6 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 with Priority: HIGHEST for action port [ 1050.474793] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_rules [ 1050.475064] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_rules [ 1050.475064] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 with Priority: HIGHEST for action port [ 1050.475219] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1050.475219] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_members [ 1050.475449] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.475643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.475643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.475795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.475874] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.476805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7bb67ab-c436-40df-93c3-37d1a6727527 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.476892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.476943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.477206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.477206] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.477929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e59bd35-0028-4167-b18d-84ff4346a0f6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.478051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.478132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.478304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.478379] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e59bd35-0028-4167-b18d-84ff4346a0f6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.481785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.481931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.482117] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb67ab-c436-40df-93c3-37d1a6727527 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.482207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.802098] env[69238]: INFO networking_nsxv3.common.synchronization [req-251b8e77-f07e-49cd-a240-f8418dffddae req-5428b30d-f7b0-4b74-b291-4878341f8ab3 tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1050.802641] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1050.802949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.803709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.803792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.803995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.804171] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.804278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.804501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.804570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.804656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.804750] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.809489] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.810556] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.982369] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e59bd35-0028-4167-b18d-84ff4346a0f6 with status ACTIVE [ 1050.982662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.982804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.982869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.983099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.983190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.983369] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.983467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.983529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.983673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.983747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.983925] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.984027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.984091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.984226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.984301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.984382] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 is going to be updated. [ 1050.985554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb67ab-c436-40df-93c3-37d1a6727527 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.985650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.985945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.986058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.047021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.047243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.047243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.047458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.048893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.049099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.307447] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.312149] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.313048] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.486323] env[69238]: INFO networking_nsxv3.common.synchronization [req-bc839a22-c816-4496-ac29-010226b2c2f4 req-f4bc0c65-fb92-4b20-9e06-e9c836d59ab0 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1051.486323] env[69238]: INFO networking_nsxv3.common.synchronization [req-bc839a22-c816-4496-ac29-010226b2c2f4 req-f4bc0c65-fb92-4b20-9e06-e9c836d59ab0 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1051.486323] env[69238]: INFO networking_nsxv3.common.synchronization [req-bc839a22-c816-4496-ac29-010226b2c2f4 req-f4bc0c65-fb92-4b20-9e06-e9c836d59ab0 service nova] Enqueued Resource ID: e1b5ea8b-761d-467d-806b-5b572f71466f with Priority: HIGHEST for action port [ 1051.486323] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1051.486323] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1051.486323] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1b5ea8b-761d-467d-806b-5b572f71466f with Priority: HIGHEST for action port [ 1051.488472] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.488774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.488774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.488920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.489016] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.490780] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.490903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.491886] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1b5ea8b-761d-467d-806b-5b572f71466f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.491886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.491886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.491886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.491886] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1b5ea8b-761d-467d-806b-5b572f71466f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.686657] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 in Status: SUCCESS [ 1051.686824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.810144] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.818883] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.818883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.819044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.819189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.819310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.819430] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb67ab-c436-40df-93c3-37d1a6727527 is going to be created. [ 1051.820960] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.821115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.821295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.821382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.821473] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.822176] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be updated. [ 1051.856359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.856576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.856620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.856869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.857175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.860213] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.860471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.860567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.860737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.860924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.869644] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: IN_PROGRESS for 2s [ 1051.870413] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7bb67ab-c436-40df-93c3-37d1a6727527 in Status: UNINITIALIZED for 2s [ 1051.947723] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.948047] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.948233] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.948580] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.949265] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.949505] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.949667] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.952204] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.952821] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.953269] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.954206] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.954206] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.954395] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.954550] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.954774] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.954969] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.984866] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.985069] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.985223] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.985439] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.986158] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-e33e1016-f28d-488a-96c4-c66b39959843 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.986158] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.986158] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.986639] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.988388] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e33e1016-f28d-488a-96c4-c66b39959843',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.996230] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1b5ea8b-761d-467d-806b-5b572f71466f with status ACTIVE [ 1051.996565] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.996755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.996857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.997146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.997285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.997543] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.997692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.997787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.997996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.998200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.998414] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.998551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.998643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.998840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.998948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.999406] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1b5ea8b-761d-467d-806b-5b572f71466f is going to be updated. [ 1052.001889] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.002038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.012657] env[69238]: INFO networking_nsxv3.common.synchronization [req-3a6595ec-fe03-463e-8c9c-f79262fb63b6 req-e29505f4-0020-4ae7-97f8-a9694d2b33f0 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_members [ 1052.012946] env[69238]: INFO networking_nsxv3.common.synchronization [req-3a6595ec-fe03-463e-8c9c-f79262fb63b6 req-e29505f4-0020-4ae7-97f8-a9694d2b33f0 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1052.014602] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7bb67ab-c436-40df-93c3-37d1a6727527 with Priority: HIGHEST for action security_group_members [ 1052.014602] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1052.014758] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7bb67ab-c436-40df-93c3-37d1a6727527 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.015156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.015725] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.015913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.026430] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.026645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.026753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.027083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.027310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.027559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1b5ea8b-761d-467d-806b-5b572f71466f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.055308] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1052.055618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.055853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.056161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.056435] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.056617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.056729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.056980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.057132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.057285] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.107583] env[69238]: INFO networking_nsxv3.common.synchronization [req-3a6595ec-fe03-463e-8c9c-f79262fb63b6 req-e29505f4-0020-4ae7-97f8-a9694d2b33f0 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_rules [ 1052.108072] env[69238]: INFO networking_nsxv3.common.synchronization [req-3a6595ec-fe03-463e-8c9c-f79262fb63b6 req-e29505f4-0020-4ae7-97f8-a9694d2b33f0 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1052.111101] env[69238]: INFO networking_nsxv3.common.synchronization [req-3a6595ec-fe03-463e-8c9c-f79262fb63b6 req-e29505f4-0020-4ae7-97f8-a9694d2b33f0 tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 with Priority: HIGHEST for action port [ 1052.111101] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_rules [ 1052.111101] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1052.111101] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 with Priority: HIGHEST for action port [ 1052.111101] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.111101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.111101] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.111101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.111101] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e59bd35-0028-4167-b18d-84ff4346a0f6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.111101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.115585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.115585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.115585] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e59bd35-0028-4167-b18d-84ff4346a0f6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.318583] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.319422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.321941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.321941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.321941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.321941] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1052.357493] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.357493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.357493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.357493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.357493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.383021] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1052.491820] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.495133] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port e33e1016-f28d-488a-96c4-c66b39959843 not found, creating... [ 1052.495133] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.495133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.496392] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.496803] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.497404] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.497763] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.498032] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.498327] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: e33e1016-f28d-488a-96c4-c66b39959843 is going to be created. [ 1052.523401] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.523401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.523401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.523401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.523401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.523401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.562957] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.616299] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e59bd35-0028-4167-b18d-84ff4346a0f6 with status ACTIVE [ 1052.616599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.616775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.616852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.617178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.617294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.617540] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.617687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.617791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.617980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.618109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.618513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.618634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.618703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.618933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.619080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.619185] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e59bd35-0028-4167-b18d-84ff4346a0f6 is going to be updated. [ 1052.646497] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.646668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.646719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.646932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.647104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.647276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e59bd35-0028-4167-b18d-84ff4346a0f6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.066485] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.483221] env[69238]: INFO networking_nsxv3.common.synchronization [req-251b8e77-f07e-49cd-a240-f8418dffddae req-6ce856a9-87cc-4dfb-8862-09be1d261a7b service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 1053.483392] env[69238]: INFO networking_nsxv3.common.synchronization [req-251b8e77-f07e-49cd-a240-f8418dffddae req-6ce856a9-87cc-4dfb-8862-09be1d261a7b service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1053.483531] env[69238]: INFO networking_nsxv3.common.synchronization [req-251b8e77-f07e-49cd-a240-f8418dffddae req-6ce856a9-87cc-4dfb-8862-09be1d261a7b service nova] Enqueued Resource ID: e33e1016-f28d-488a-96c4-c66b39959843 with Priority: HIGHEST for action port [ 1053.483826] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 1053.487021] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1053.487021] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33e1016-f28d-488a-96c4-c66b39959843 with Priority: HIGHEST for action port [ 1053.487021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.487021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.487021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.487021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.487021] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.487021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.487021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.487021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-e33e1016-f28d-488a-96c4-c66b39959843 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.487021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.487021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.487021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.487021] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e33e1016-f28d-488a-96c4-c66b39959843',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.570290] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.570290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.570290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.570689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.570689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.570813] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1053.606257] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.606412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.606460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.608018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.608018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.617596] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1053.885519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7bb67ab-c436-40df-93c3-37d1a6727527 in Status: SUCCESS [ 1053.885748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.886512] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1053.886693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.887436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.887436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.887436] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.887436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.887754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.887754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.887754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.887990] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.889803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.891431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.891633] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.891749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.891816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.892689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.892689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.892689] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.991605] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.991750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.991932] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e33e1016-f28d-488a-96c4-c66b39959843 with status ACTIVE [ 1053.992132] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.992307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.992625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.992625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.992730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.992878] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.993076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.993076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.993260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.993326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.993537] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.993692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.993778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.995445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.995445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.995445] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e33e1016-f28d-488a-96c4-c66b39959843 is going to be updated. [ 1054.025107] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.025350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.025350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.025608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.025687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.025820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e33e1016-f28d-488a-96c4-c66b39959843" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.398019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.398019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.398019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.398019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb67ab-c436-40df-93c3-37d1a6727527 is going to be deleted. [ 1054.398019] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.405754] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1054.405993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.406194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.406410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.406595] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.406712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.406777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.406923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.407010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.407108] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.476258] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.476498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.476498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.476829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.476891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.476977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.477147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.477312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.477483] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.477581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.477642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.477779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.477853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.477943] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.908611] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.911115] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.981017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.981254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.981254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.981513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.981619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.981836] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.982023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.982023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.982160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.982237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.982324] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb67ab-c436-40df-93c3-37d1a6727527 already deleted. [ 1054.982401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.982504] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.983370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.983636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.983698] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.983769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.983832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.983970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.984058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.984142] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.411762] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.411929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.411999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.412250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.412377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.412430] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be updated. [ 1055.414088] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.444354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.444504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.444571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.444785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.444936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.454642] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: IN_PROGRESS for 2s [ 1055.489440] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7bb67ab-c436-40df-93c3-37d1a6727527',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.490617] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.490755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.490839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.491069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.491183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.491439] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.491567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.491629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.491815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.491901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.491990] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7bb67ab-c436-40df-93c3-37d1a6727527 already deleted. [ 1055.492095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.629545] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1055.629833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.630046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.630307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.630551] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.630696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.630784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.630990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.631112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.631208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.631321] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.918223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.918677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.918677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.918677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.918816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.918923] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1055.951702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.951903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.951971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.952218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.952372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.966014] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1055.993553] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7bb67ab-c436-40df-93c3-37d1a6727527: rpc.has_security_group_logging(os_id): False [ 1056.015383] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.015675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.015675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.016023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.016023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.016172] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.016262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.016351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.016440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.016516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.016603] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7bb67ab-c436-40df-93c3-37d1a6727527 is going to be created. [ 1056.042831] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b7bb67ab-c436-40df-93c3-37d1a6727527], does not exist path=[/infra/domains/default/groups/b7bb67ab-c436-40df-93c3-37d1a6727527]."\n}' [ 1056.043295] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7bb67ab-c436-40df-93c3-37d1a6727527 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b7bb67ab-c436-40df-93c3-37d1a6727527 [ 1056.043295] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1056.088397] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.088686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.088686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.088868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.090747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.091160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.091368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.091443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.091651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.091738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.091970] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.092098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.092185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.092343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.092421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.092509] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7bb67ab-c436-40df-93c3-37d1a6727527 is going to be created. [ 1056.113582] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b7bb67ab-c436-40df-93c3-37d1a6727527], does not exist path=[/infra/domains/default/groups/b7bb67ab-c436-40df-93c3-37d1a6727527]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b7bb67ab-c436-40df-93c3-37d1a6727527 [ 1056.113796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7bb67ab-c436-40df-93c3-37d1a6727527" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.114616] env[69238]: Traceback (most recent call last): [ 1056.114616] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1056.114616] env[69238]: return func(*args, **kwargs) [ 1056.114616] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1056.114616] env[69238]: res.raise_for_status() [ 1056.114616] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1056.114616] env[69238]: raise HTTPError(http_error_msg, response=self) [ 1056.114616] env[69238]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b7bb67ab-c436-40df-93c3-37d1a6727527 [ 1056.114616] env[69238]: During handling of the above exception, another exception occurred: [ 1056.114616] env[69238]: Traceback (most recent call last): [ 1056.114616] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1056.114616] env[69238]: listener.cb(fileno) [ 1056.114616] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1056.114616] env[69238]: result = function(*args, **kwargs) [ 1056.114616] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1056.114616] env[69238]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1056.114616] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1056.114616] env[69238]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1056.114616] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1056.114616] env[69238]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1056.114616] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1056.114616] env[69238]: res.raise_for_status() [ 1056.114616] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1056.114616] env[69238]: raise HTTPError(http_error_msg, response=self) [ 1056.114616] env[69238]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b7bb67ab-c436-40df-93c3-37d1a6727527 [ 1056.114616] env[69238]: Removing descriptor: 62 [ 1056.136745] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.136914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.136998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.137226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.137402] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.137510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.137565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.137718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.137827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.137881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.138052] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.138122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.138170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.138347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.138445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.138535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.138593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.138781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.138781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.138899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.138941] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.300169] env[69238]: INFO networking_nsxv3.common.synchronization [req-03851cff-3824-408f-bcff-da2727dbdb4c req-b85326a5-80be-4e5d-a5c6-aedbb5586319 tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_members [ 1056.300767] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_members [ 1056.302059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.302059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.302059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.302059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.302059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.302378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.302378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.302573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.302683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.302782] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.504247] env[69238]: INFO networking_nsxv3.common.synchronization [req-fa1f524c-a9eb-41b3-bade-132077dff017 req-9b3170ad-7253-4028-998f-05398040a00a tempest-ServersNegativeTestMultiTenantJSON-184179782 tempest-ServersNegativeTestMultiTenantJSON-184179782-project-member] Enqueued Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_members [ 1056.504789] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 with Priority: HIGHEST for action security_group_members [ 1056.505123] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-f19e634f-6fff-469e-93a7-10ba29d4b8a8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.505277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.505337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.505505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.505655] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.505751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.505808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.505949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.506526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.506679] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f19e634f-6fff-469e-93a7-10ba29d4b8a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.641465] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1056.660463] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.660666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.660740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.660996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.684182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.684424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.684542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.684594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.684843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.684955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.685051] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.685147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.685204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.685353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.685420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.685624] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.685696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.685754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.685874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.685942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.686034] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1056.764353] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.764534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.764626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.764962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.765146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.784319] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1056.804982] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.805228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.805307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.805525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.805630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.805805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.805903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.805973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.808099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.808099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.808099] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c767742c-a318-4de7-875d-b9006231b601 already deleted. [ 1056.808099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.012160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.012417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.012417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.012628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.037284] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.037551] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.037663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.037725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.037936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.038040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.038134] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 is going to be updated. [ 1057.067640] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.067839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.067839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.068068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.068235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.079021] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 in Status: IN_PROGRESS for 2s [ 1057.252296] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.252296] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.252296] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.253059] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.253353] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.253527] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.253653] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.253892] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.254117] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.254279] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.254402] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.254520] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.254633] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.254747] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.254856] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.254995] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.278995] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.279205] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1057.279351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.279540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.279864] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-31c4365e-baa5-4856-abf0-513731b2e2a0 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.280049] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.280176] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.280579] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.280727] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31c4365e-baa5-4856-abf0-513731b2e2a0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.471410] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1057.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.472337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.472548] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.472716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.472796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.473589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.473589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.473589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.473589] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.474581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.474581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.474581] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.474581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.474581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.474977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.474977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.474977] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.786183] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.786183] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 31c4365e-baa5-4856-abf0-513731b2e2a0 not found, creating... [ 1057.786183] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.786183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.786598] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.787498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.787794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.788367] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.788702] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.789089] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 31c4365e-baa5-4856-abf0-513731b2e2a0 is going to be created. [ 1057.814866] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.814866] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.814866] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.814866] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.814866] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.814866] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.979022] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1057.979022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.979022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.979022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.979022] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.979022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.979022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.979572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.979839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.981717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.981717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.981717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.981717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.981717] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.329025] env[69238]: INFO networking_nsxv3.common.synchronization [req-de6bc1a7-e95b-431b-920f-53b3480fb579 req-8ad6dda6-d01a-4e52-bc87-2eb47d9534d6 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1058.329025] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1058.329862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.332267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.332267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.332267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.332267] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.332267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.332267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.332267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.332267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.332267] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.486903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.486903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.486903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.486903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.486903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.487523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.487523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.487523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.487523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.487523] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.488452] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.800537] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1058.800537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.837972] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.837972] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.837972] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 already deleted. [ 1058.837972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.994091] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9df4a22-2e58-46f6-9dc8-bffb28401a54: rpc.has_security_group_logging(os_id): False [ 1058.994091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.994091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.994091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.994091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.994091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.994091] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be updated. [ 1059.015327] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.015327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.015327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.015327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.028593] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.028593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.028593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.028593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.028593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.035972] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: IN_PROGRESS for 2s [ 1059.037303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.038503] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.038821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.041083] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.041083] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.041083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.041083] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1059.089580] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 in Status: SUCCESS [ 1059.089580] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f19e634f-6fff-469e-93a7-10ba29d4b8a8 deletion is rescheduled due to dependency. [ 1059.089580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f19e634f-6fff-469e-93a7-10ba29d4b8a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.108027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.108027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.108027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.108027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.108027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.125463] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1059.188282] env[69238]: INFO networking_nsxv3.common.synchronization [req-03851cff-3824-408f-bcff-da2727dbdb4c req-6d485119-85ee-434e-8e47-0ffaacf116e4 service nova] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_rules [ 1059.188282] env[69238]: INFO networking_nsxv3.common.synchronization [req-03851cff-3824-408f-bcff-da2727dbdb4c req-6d485119-85ee-434e-8e47-0ffaacf116e4 service nova] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_members [ 1059.188282] env[69238]: INFO networking_nsxv3.common.synchronization [req-03851cff-3824-408f-bcff-da2727dbdb4c req-6d485119-85ee-434e-8e47-0ffaacf116e4 service nova] Enqueued Resource ID: 31c4365e-baa5-4856-abf0-513731b2e2a0 with Priority: HIGHEST for action port [ 1059.189047] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_rules [ 1059.189391] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_members [ 1059.189776] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31c4365e-baa5-4856-abf0-513731b2e2a0 with Priority: HIGHEST for action port [ 1059.190302] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.190669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.190910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.191341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.191592] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.193889] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.193889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.193889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.193889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.193889] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.193889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.194475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.194821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.195062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.196098] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.196610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-31c4365e-baa5-4856-abf0-513731b2e2a0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.198028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.198028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.198028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.198028] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31c4365e-baa5-4856-abf0-513731b2e2a0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.305960] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.306251] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.306346] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.306723] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.307022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.307369] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.307505] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.307739] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.307891] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.308121] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.308258] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.308411] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.308522] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.308642] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.308768] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.308917] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.328969] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.328969] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.328969] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.328969] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.329492] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-adc8b6dd-af64-4db7-82ac-ce137cc386d4 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.329492] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.329492] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.329925] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.330137] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc8b6dd-af64-4db7-82ac-ce137cc386d4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.700542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.700779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.701054] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.702650] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31c4365e-baa5-4856-abf0-513731b2e2a0 with status ACTIVE [ 1059.702650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.702839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.702839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.703785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.704138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.704226] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.704499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.704616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.704878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.705021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.705514] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.705885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.705885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.706045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.706199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.706325] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31c4365e-baa5-4856-abf0-513731b2e2a0 is going to be updated. [ 1059.745048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.745048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.745048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.745048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.745048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.745745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31c4365e-baa5-4856-abf0-513731b2e2a0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.832998] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.833259] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.833392] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.833719] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.833902] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.834095] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port adc8b6dd-af64-4db7-82ac-ce137cc386d4 not found, creating... [ 1059.834378] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.834552] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.834675] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.834912] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.835073] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.835369] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.835528] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.835730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.835867] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.836013] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.836166] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: adc8b6dd-af64-4db7-82ac-ce137cc386d4 is going to be created. [ 1059.879021] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.879319] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.879463] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.879801] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.880188] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.880485] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.210048] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.675202] env[69238]: INFO networking_nsxv3.common.synchronization [req-9749fd34-302f-4021-b925-67286bdc5567 req-df85dc0b-d66f-4939-9722-980d4558d9c5 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1060.675202] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1060.676310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.676620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.676794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.677199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.677472] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.677744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.679459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.679459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.679459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.679459] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.714435] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.714435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.714435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.714435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.714435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.714435] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c767742c-a318-4de7-875d-b9006231b601 is going to be created. [ 1060.749395] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.749395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.749395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.749395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.749395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.761744] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: UNINITIALIZED for 2s [ 1061.048710] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1061.048710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.048710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.048710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.048710] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.048710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.048710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.048710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.048710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.048710] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.141734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1061.142481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.184787] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.184787] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.184787] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe already deleted. [ 1061.184787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.275026] env[69238]: INFO networking_nsxv3.common.synchronization [req-de6bc1a7-e95b-431b-920f-53b3480fb579 req-63ba3dc3-80cf-43d3-9ffb-c67c8983cc80 service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1061.275026] env[69238]: INFO networking_nsxv3.common.synchronization [req-de6bc1a7-e95b-431b-920f-53b3480fb579 req-63ba3dc3-80cf-43d3-9ffb-c67c8983cc80 service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1061.275026] env[69238]: INFO networking_nsxv3.common.synchronization [req-de6bc1a7-e95b-431b-920f-53b3480fb579 req-63ba3dc3-80cf-43d3-9ffb-c67c8983cc80 service nova] Enqueued Resource ID: adc8b6dd-af64-4db7-82ac-ce137cc386d4 with Priority: HIGHEST for action port [ 1061.275026] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1061.275026] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1061.275026] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adc8b6dd-af64-4db7-82ac-ce137cc386d4 with Priority: HIGHEST for action port [ 1061.275505] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.275757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.275918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.276351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.276581] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.278331] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.279210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.279463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.279886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.280194] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.280433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.280614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.280981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.281206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.281697] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.284664] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-adc8b6dd-af64-4db7-82ac-ce137cc386d4 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.284664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.284664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.285792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.286239] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc8b6dd-af64-4db7-82ac-ce137cc386d4',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.550598] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.563231] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.563524] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.563685] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.563998] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.564292] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.564524] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.564668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.564905] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.565065] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.565317] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.565456] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.565647] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.565776] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.565896] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.566016] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.566159] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.586214] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.586482] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1061.586640] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.586826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.587165] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-9c4761cc-e738-4ce8-b168-f65e0a775f7c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.587373] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.587564] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.587941] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.588105] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c4761cc-e738-4ce8-b168-f65e0a775f7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.788329] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.789479] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.789592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.789765] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adc8b6dd-af64-4db7-82ac-ce137cc386d4 with status ACTIVE [ 1061.789943] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.790070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.790145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.790384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.790499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.790679] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.790777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.790841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.790998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.791821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.792036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.792280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.792464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.792648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.792730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.792822] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adc8b6dd-af64-4db7-82ac-ce137cc386d4 is going to be updated. [ 1061.816432] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.816660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.816660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.816826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.816982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.817165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adc8b6dd-af64-4db7-82ac-ce137cc386d4" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.054126] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.091376] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.091376] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.091591] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.091941] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.091941] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.092274] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 9c4761cc-e738-4ce8-b168-f65e0a775f7c not found, creating... [ 1062.092786] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.093036] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.093036] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.093265] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.093415] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.094734] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.094734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.094734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.094734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.094734] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.094734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c is going to be created. [ 1062.119227] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.120146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.120146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.120146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.120383] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.121751] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.295640] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.558511] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.558511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.558511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.558511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.558511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.558511] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be updated. [ 1062.587750] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.588364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.590023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.590023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.590023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.600840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: IN_PROGRESS for 2s [ 1062.775026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: SUCCESS [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.775026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.775026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.775026] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.801305] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.801305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.801305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.801305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.801305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.801305] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be created. [ 1062.826157] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.826157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.826157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.826157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.826157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.835244] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: UNINITIALIZED for 2s [ 1063.277797] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.363286] env[69238]: INFO networking_nsxv3.common.synchronization [req-9749fd34-302f-4021-b925-67286bdc5567 req-eefede7f-71b1-4826-805e-4c654be9cbbf service nova] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1063.363286] env[69238]: INFO networking_nsxv3.common.synchronization [req-9749fd34-302f-4021-b925-67286bdc5567 req-eefede7f-71b1-4826-805e-4c654be9cbbf service nova] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1063.363286] env[69238]: INFO networking_nsxv3.common.synchronization [req-9749fd34-302f-4021-b925-67286bdc5567 req-eefede7f-71b1-4826-805e-4c654be9cbbf service nova] Enqueued Resource ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c with Priority: HIGHEST for action port [ 1063.364751] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1063.365052] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1063.365362] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c with Priority: HIGHEST for action port [ 1063.365765] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.366124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.366385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.366748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.366939] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.368889] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.369380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.369380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.370672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.370672] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.370672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.370672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.370672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.370672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.370672] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.371201] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c4761cc-e738-4ce8-b168-f65e0a775f7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.371301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.371367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.371580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.371656] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c4761cc-e738-4ce8-b168-f65e0a775f7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.784039] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c767742c-a318-4de7-875d-b9006231b601: rpc.has_security_group_logging(os_id): False [ 1063.804044] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.804044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.804044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.804044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.804517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.804720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.805509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.805509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.805509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.805509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.805832] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c767742c-a318-4de7-875d-b9006231b601 is going to be created. [ 1063.876897] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.877430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.877640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.878825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.878825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.879646] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.879646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.880323] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.881805] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c4761cc-e738-4ce8-b168-f65e0a775f7c with status ACTIVE [ 1063.882069] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.882338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.882568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.882766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.882909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.883155] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.886907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.886992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.887367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.887465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.887702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.887804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.887871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.888051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.888135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.888229] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c is going to be updated. [ 1063.904545] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: IN_PROGRESS for 2s [ 1063.913228] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.913449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.913520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.913808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.913994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.914305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.391274] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.611449] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1064.611810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.612750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.612750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.612750] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.612750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.612750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.612750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.612750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.613780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.614061] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.614202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.614272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.614479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.614635] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.614749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.614801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.615053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.615325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.615456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.615556] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.852142] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1064.852543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.853549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.853849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.854307] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.854532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.854602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.854730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.854837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.854955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.855065] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.860644] env[69238]: INFO networking_nsxv3.common.synchronization [req-48080474-a364-4ea6-8e22-cb54c296161e req-706fa9fb-a61f-4641-a909-e1efd54ce893 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1064.861604] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1064.861604] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.861604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.861604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.861954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.861991] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.862099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.862148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.862312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.862413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.862506] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.892648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.892874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.892945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.893178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.893264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.893363] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be created. [ 1064.923461] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.923609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.923664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.923876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.924051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.941035] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: UNINITIALIZED for 2s [ 1065.120375] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a42013c-f7b7-4df2-92c5-c960a9c82f77: rpc.has_security_group_logging(os_id): False [ 1065.146264] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.146482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.146482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.147022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.172891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.173194] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.173382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.173455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.173659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.173749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.174031] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.174354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.174354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.174480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.174563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.174758] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.174855] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.174917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.175579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.175718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.175840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be updated. [ 1065.283888] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.283888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.283888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.284408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.285686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.302028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: IN_PROGRESS for 2s [ 1065.358885] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.360612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.360761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.361117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.361294] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.361518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.361584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.361854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.362024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.362496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.362496] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.362496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.362496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.362699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.363057] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.363057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.363153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.363264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.363367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.363471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.363584] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.364665] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.365304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.369226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.369515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.403142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.403418] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.403544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.403615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.403825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.403912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.404009] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1065.436846] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.437106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.437169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.437398] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.437628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.461278] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1065.854618] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.855129] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.855129] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.855335] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.855614] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.855820] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.855969] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.859449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.859449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.859663] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.859704] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.860265] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.860440] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.860604] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.860730] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.860917] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.872889] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b42b8e-961a-4b49-a6b3-231d9a561dc5: rpc.has_security_group_logging(os_id): False [ 1065.889991] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.890190] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.890312] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.890592] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.890994] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-63462c74-6c4f-4422-a85b-68ba5b1557a8 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.891207] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.891334] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.891766] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.891974] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63462c74-6c4f-4422-a85b-68ba5b1557a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.894299] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.894452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.894535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.894723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.894879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.895032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.895160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.895221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.895386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.895458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.895716] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.895820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.895861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.895988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.896242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.896501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.896604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.896666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.896825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.896904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.897032] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be created. [ 1065.917182] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: SUCCESS [ 1065.917470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.980848] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.981076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.981076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.981286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.981467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.993395] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1066.389289] env[69238]: INFO networking_nsxv3.common.synchronization [req-30ed7be6-ab7c-447c-8fca-650a8cbad715 req-25a3eda8-0360-4c0e-9828-f099d6a024dd tempest-ServerRescueTestJSONUnderV235-1503219213 tempest-ServerRescueTestJSONUnderV235-1503219213-project-member] Enqueued Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1066.389977] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 with Priority: HIGHEST for action security_group_members [ 1066.390599] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a42013c-f7b7-4df2-92c5-c960a9c82f77 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.390738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.390808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.391017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.391194] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.391330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.391410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.391593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.391694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.391796] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.399649] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.399924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.400083] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.400501] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.400729] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.401218] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 63462c74-6c4f-4422-a85b-68ba5b1557a8 not found, creating... [ 1066.404951] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.404951] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.404951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.405493] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 63462c74-6c4f-4422-a85b-68ba5b1557a8 is going to be created. [ 1066.429390] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.429613] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.429743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.430124] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.430397] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.430686] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.893816] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.894123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.894123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.894774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.894774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.894774] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.894774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.894774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.895097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.895097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.895411] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be updated. [ 1066.935426] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.935426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.935426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.935426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.935426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.949652] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: IN_PROGRESS for 2s [ 1066.961979] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.963825] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.963825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.963825] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.197401] env[69238]: INFO networking_nsxv3.common.synchronization [req-bd535677-0760-4173-8932-1de943f8fbc2 req-98e6b432-5fd9-4c98-b8be-bcad2a7c5a5e tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1067.198037] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1067.198310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.198453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.198528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.198770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.198930] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.202310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.202310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.202310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.202310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.202310] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.316126] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1067.316371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.316605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.316821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.316924] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a42013c-f7b7-4df2-92c5-c960a9c82f77',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.374573] env[69238]: INFO networking_nsxv3.common.synchronization [req-48080474-a364-4ea6-8e22-cb54c296161e req-cbefc800-8e80-4256-8f2c-ec626a7fc1be service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1067.374755] env[69238]: INFO networking_nsxv3.common.synchronization [req-48080474-a364-4ea6-8e22-cb54c296161e req-cbefc800-8e80-4256-8f2c-ec626a7fc1be service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1067.374895] env[69238]: INFO networking_nsxv3.common.synchronization [req-48080474-a364-4ea6-8e22-cb54c296161e req-cbefc800-8e80-4256-8f2c-ec626a7fc1be service nova] Enqueued Resource ID: 63462c74-6c4f-4422-a85b-68ba5b1557a8 with Priority: HIGHEST for action port [ 1067.375153] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1067.375339] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1067.375409] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63462c74-6c4f-4422-a85b-68ba5b1557a8 with Priority: HIGHEST for action port [ 1067.376040] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.378197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.378291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.378464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.378553] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.382099] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.382099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.385929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-63462c74-6c4f-4422-a85b-68ba5b1557a8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.385929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.385929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.385929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.385929] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63462c74-6c4f-4422-a85b-68ba5b1557a8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.472025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.472025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.472025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.472025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.472025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.472967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.472967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.472967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.472967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.472967] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.473860] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1067.474031] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be deletion is rescheduled due to dependency. [ 1067.474130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.474539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.474701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.474845] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.474940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.474995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.478371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.478371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.478371] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.704244] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.839495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.839706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.839706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.839910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.840011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.840117] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 is going to be deleted. [ 1067.884568] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.884689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.884908] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63462c74-6c4f-4422-a85b-68ba5b1557a8 with status ACTIVE [ 1067.885087] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.885196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.885264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.885470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.885558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.885730] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.885830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.885885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.886480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.886480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.886480] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.886480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.886480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.886806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.886806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.886806] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63462c74-6c4f-4422-a85b-68ba5b1557a8 is going to be updated. [ 1067.902904] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.902904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.902904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.902904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.903594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.903594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.909927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.910078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.910147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.910344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.910505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.910679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63462c74-6c4f-4422-a85b-68ba5b1557a8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.976544] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe: rpc.has_security_group_logging(os_id): False [ 1067.980664] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.995640] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.995640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.995803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.995892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.995976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.996175] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.996271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.996334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.996476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.996646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.996738] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.996829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.996890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.997036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.997113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.997296] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.997387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.997447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.997583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.997846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.997948] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be created. [ 1068.020791] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1068.021024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.092154] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.092154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.092154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.092154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.092154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.109508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1068.206778] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.482626] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.712715] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.712943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.712943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.713160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.713257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.713361] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1068.743092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.743299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.743299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.743534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.743681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.754818] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1068.961476] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 in Status: SUCCESS [ 1068.961944] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a42013c-f7b7-4df2-92c5-c960a9c82f77 deletion is rescheduled due to dependency. [ 1068.962193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a42013c-f7b7-4df2-92c5-c960a9c82f77" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.984828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.985087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.985087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.985279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.985379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.985468] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1069.017881] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.018128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.018128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.018364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.018538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.027518] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1070.121869] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1070.122238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.766384] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1070.766715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.039082] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1071.039296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.039476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.039710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.039914] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.040032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.040102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.040260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.040345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.040432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.040590] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.542961] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.543254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.543378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.543600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.543772] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.543863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.543926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.544088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.545279] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.545279] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.545279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.545848] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.047566] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6984856-6c1b-4d02-a5b7-08f98ac851be: rpc.has_security_group_logging(os_id): False [ 1072.072759] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.072759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.072759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.073019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.073055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.073249] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.073458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.073458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.073602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.073649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.073808] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.073901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.073956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.074109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.074186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.074393] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.074489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.074552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.074694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.074765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.074847] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1072.208606] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.208606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.208606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.208917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.208917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.234129] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1072.376528] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1072.376748] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1074.034366] env[69238]: INFO networking_nsxv3.common.synchronization [None req-51e92892-9dd5-4ceb-8c00-df839ad4901f tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1074.035827] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1074.036844] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.037124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.037276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.037600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.037881] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.038103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.038249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.038593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.038783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.038963] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.068103] env[69238]: INFO networking_nsxv3.common.synchronization [req-53c40324-3c42-41a5-9985-1f2222f2e5b5 req-0e38ac1b-75ac-48f9-84c0-669b3cd9c9de tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.070530] env[69238]: INFO networking_nsxv3.common.synchronization [req-53c40324-3c42-41a5-9985-1f2222f2e5b5 req-0e38ac1b-75ac-48f9-84c0-669b3cd9c9de tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.071522] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.072450] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.075072] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.076066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.076235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.076566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.077442] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.077584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.077730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.078296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.078296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.078396] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.079732] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.079947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.080101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.080472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.080772] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.081095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.081095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.081429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.081612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.081791] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.145118] env[69238]: INFO networking_nsxv3.common.synchronization [None req-2c787b28-745c-4785-86cc-1854bab92cf2 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: b23e521f-8c8e-4539-9e68-4cda573e291c with Priority: HIGHEST for action security_group_rules [ 1074.145792] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b23e521f-8c8e-4539-9e68-4cda573e291c with Priority: HIGHEST for action security_group_rules [ 1074.145922] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b23e521f-8c8e-4539-9e68-4cda573e291c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.146055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.146128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.146357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.146439] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b23e521f-8c8e-4539-9e68-4cda573e291c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.159959] env[69238]: INFO networking_nsxv3.common.synchronization [req-53c40324-3c42-41a5-9985-1f2222f2e5b5 req-0e38ac1b-75ac-48f9-84c0-669b3cd9c9de tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_rules [ 1074.160170] env[69238]: INFO networking_nsxv3.common.synchronization [req-53c40324-3c42-41a5-9985-1f2222f2e5b5 req-0e38ac1b-75ac-48f9-84c0-669b3cd9c9de tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.160396] env[69238]: INFO networking_nsxv3.common.synchronization [req-53c40324-3c42-41a5-9985-1f2222f2e5b5 req-0e38ac1b-75ac-48f9-84c0-669b3cd9c9de tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1074.160606] env[69238]: INFO networking_nsxv3.common.synchronization [req-53c40324-3c42-41a5-9985-1f2222f2e5b5 req-0e38ac1b-75ac-48f9-84c0-669b3cd9c9de tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.160755] env[69238]: INFO networking_nsxv3.common.synchronization [req-53c40324-3c42-41a5-9985-1f2222f2e5b5 req-0e38ac1b-75ac-48f9-84c0-669b3cd9c9de tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c with Priority: HIGHEST for action port [ 1074.161392] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_rules [ 1074.161392] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1074.161871] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c with Priority: HIGHEST for action port [ 1074.161871] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.161871] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.162135] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.162135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.162135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.162672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.162672] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.163329] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.163442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.163529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.163662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.163732] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.164450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c4761cc-e738-4ce8-b168-f65e0a775f7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.164589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.164653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.165209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.165209] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c4761cc-e738-4ce8-b168-f65e0a775f7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.165706] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.165706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.165878] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.166016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.248819] env[69238]: INFO networking_nsxv3.common.synchronization [None req-25353ab3-e84e-41a3-b258-430277077ef6 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: b23e521f-8c8e-4539-9e68-4cda573e291c with Priority: HIGHEST for action security_group_rules [ 1074.249436] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b23e521f-8c8e-4539-9e68-4cda573e291c with Priority: HIGHEST for action security_group_rules [ 1074.249712] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b23e521f-8c8e-4539-9e68-4cda573e291c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.250130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.250830] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1074.251045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.541420] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.584431] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.585522] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.668834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.669108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.669280] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c4761cc-e738-4ce8-b168-f65e0a775f7c with status ACTIVE [ 1074.669781] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.669934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.672393] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.672393] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.672393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.672393] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c is going to be updated. [ 1074.674140] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.674140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.675024] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.675177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.675287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.675453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.677533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.677533] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b23e521f-8c8e-4539-9e68-4cda573e291c already deleted. [ 1074.677533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.677533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.677533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.677533] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b23e521f-8c8e-4539-9e68-4cda573e291c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.708787] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.709315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.709443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.709745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.709871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.710121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.783847] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.786097] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.786097] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_members [ 1074.786097] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.786097] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.786097] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_members [ 1074.787635] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.787999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.788815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.790619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.791463] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.793037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.793037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.793279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.793475] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.793608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.793677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.793885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.793982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.794140] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.847475] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_rules [ 1074.847746] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_members [ 1074.847999] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_rules [ 1074.848336] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.848602] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1074.848844] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.849140] env[69238]: INFO networking_nsxv3.common.synchronization [req-ff2295d2-b697-4621-8049-7936e709f162 req-03e07e3e-6613-4f80-a99c-d6daa8a19264 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c with Priority: HIGHEST for action port [ 1074.849909] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_rules [ 1074.850189] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_rules [ 1074.850360] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1074.850465] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c with Priority: HIGHEST for action port [ 1074.850966] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1074.855035] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_members [ 1074.855035] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1074.855035] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.855035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.855035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.855035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.855035] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.855035] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.855035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.855035] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.855035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.855035] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c4761cc-e738-4ce8-b168-f65e0a775f7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.856156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.856156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.856156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.856156] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c4761cc-e738-4ce8-b168-f65e0a775f7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.857266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.857266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.857266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.857470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.857984] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.858111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.043782] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.087669] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.089259] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.202335] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.202508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.202591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.202837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.202944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.203056] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b23e521f-8c8e-4539-9e68-4cda573e291c already deleted. [ 1075.203154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b23e521f-8c8e-4539-9e68-4cda573e291c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.298169] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.359798] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c4761cc-e738-4ce8-b168-f65e0a775f7c with status ACTIVE [ 1075.360161] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.360877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.360877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.360877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.360877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.361264] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.361264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.361405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.361628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.361714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.361905] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.362011] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.362071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.362313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.362483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.362521] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c4761cc-e738-4ce8-b168-f65e0a775f7c is going to be updated. [ 1075.363960] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.363960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.394960] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.395155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.395204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.395471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.395604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.395736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c4761cc-e738-4ce8-b168-f65e0a775f7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.546575] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.546796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.546796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.547052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.547150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.547256] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1075.590823] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.590823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.590823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.590823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.590823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.591966] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.592289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.595025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.595025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.595025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.595025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1075.595025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.595025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.595025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.595025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.595025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.595025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be created. [ 1075.603258] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1075.629123] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.629123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.629123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.629123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.629123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.631619] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.631997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.632327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.632779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.633386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.644825] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1075.645929] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: UNINITIALIZED for 2s [ 1075.803518] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.090048] env[69238]: INFO networking_nsxv3.common.synchronization [req-86dd956b-120c-43b7-b21b-561af5652f14 req-50dbf122-c79f-4053-afb4-081e686963a1 tempest-MigrationsAdminTest-400782288 tempest-MigrationsAdminTest-400782288-project-member] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 1076.090422] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGHEST for action security_group_members [ 1076.090802] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.090895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.091055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.091252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.091399] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.091519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.091601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.091786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.091896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.092009] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.204291] env[69238]: INFO networking_nsxv3.common.synchronization [req-0029ae79-d684-4062-a2ab-3b5196be7a97 req-08b47e06-63a8-4f26-b491-166ab1e3eee5 tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1076.205084] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1076.205546] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.205740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.205921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.206345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.206596] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.206765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.206872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.207153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.207299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.208107] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.306659] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.306785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.306785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.307013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.307106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.307209] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 is going to be created. [ 1076.333214] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.333402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.333402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.333637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.333794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.344700] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: UNINITIALIZED for 2s [ 1076.353428] env[69238]: INFO networking_nsxv3.common.synchronization [req-04be9fd4-edd5-475e-abe1-0992723ab0d4 req-f8b66df5-94dd-4341-854b-72342c0da580 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1076.353996] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1076.354325] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.354527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.354527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.354707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.354867] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.354968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.355038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.355187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.355272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.355364] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.594864] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.595106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.595106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.595327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.616736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.616859] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.616981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.617057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.617257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.617345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.618097] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be updated. [ 1076.650996] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.651298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.651298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.651423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.651598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.660912] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: IN_PROGRESS for 2s [ 1076.711748] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.857751] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.857918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.857979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.858225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.858319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.858611] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.858678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.858823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.858905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.858905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.858982] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1076.886507] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.886676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.886718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.886913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.890040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.895596] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1076.913388] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.913591] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.913719] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.913993] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.914277] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.914443] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.914563] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.914826] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.914965] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.918341] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.918520] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.918647] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.918764] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.918883] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.918995] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.919158] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.939564] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.939836] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1076.940031] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.940242] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.940641] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-5bde05f6-7859-436d-95a2-f62e3675b65b taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.940838] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.940963] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.947752] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.947752] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bde05f6-7859-436d-95a2-f62e3675b65b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.215160] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.453762] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.453762] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 5bde05f6-7859-436d-95a2-f62e3675b65b not found, creating... [ 1077.453762] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.453762] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.454432] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.454432] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.454432] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.454916] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.455218] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.455476] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 5bde05f6-7859-436d-95a2-f62e3675b65b is going to be created. [ 1077.489033] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.489033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.489033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.489033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.489033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.489033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.615275] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1077.615667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.659026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: SUCCESS [ 1077.659026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.659026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.659026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.659026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.659026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.659026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.659026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.659026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.659026] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.660410] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1077.660811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.661106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.661394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.661705] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.662223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.662418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.662677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.662934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.663153] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.723505] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.723505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.723505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.723505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.723505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.723505] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1077.757402] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.757402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.757402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.757402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.757402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.771999] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1078.164858] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.165944] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.358404] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: SUCCESS [ 1078.358404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.358404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.358404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.358404] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.358404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.358404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.358404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.358404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.358404] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.667420] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.668455] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.674344] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c in Status: SUCCESS [ 1078.674344] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c deletion is rescheduled due to dependency. [ 1078.674344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.862619] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.907497] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1078.907497] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1078.907497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.957370] env[69238]: INFO networking_nsxv3.common.synchronization [req-8fffebba-f76a-4bcf-b1c1-03004381df59 req-e4d2cb8f-4329-4990-84d5-6ec1a673c3c1 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1078.957370] env[69238]: INFO networking_nsxv3.common.synchronization [req-8fffebba-f76a-4bcf-b1c1-03004381df59 req-e4d2cb8f-4329-4990-84d5-6ec1a673c3c1 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1078.957370] env[69238]: INFO networking_nsxv3.common.synchronization [req-8fffebba-f76a-4bcf-b1c1-03004381df59 req-e4d2cb8f-4329-4990-84d5-6ec1a673c3c1 service nova] Enqueued Resource ID: 5bde05f6-7859-436d-95a2-f62e3675b65b with Priority: HIGHEST for action port [ 1078.957370] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1078.957370] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1078.957370] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bde05f6-7859-436d-95a2-f62e3675b65b with Priority: HIGHEST for action port [ 1078.957370] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.958647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.958872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.959613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.962207] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.962207] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.962207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.962207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.962207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.962207] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.962207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.962207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.962207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.962207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.962207] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.964700] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bde05f6-7859-436d-95a2-f62e3675b65b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.964966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.965352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.966293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.966378] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bde05f6-7859-436d-95a2-f62e3675b65b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.172347] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.172347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.172347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.172347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.172347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.172347] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be updated. [ 1079.173785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.174100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.174269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.176251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.176251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.176251] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1079.211415] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.211415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.211415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.211415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.211415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.212951] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.213685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.214028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.214378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.214657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.230515] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: IN_PROGRESS for 2s [ 1079.230515] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1079.272953] env[69238]: INFO networking_nsxv3.common.synchronization [req-b18f1c40-7375-48dc-b9aa-b351cf5e0c37 req-2ab39561-26b4-45f0-9a40-0cd36cc0c80c tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1079.276346] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1079.276346] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.276346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.276346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.276346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.276346] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.276346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.276346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.276346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.276346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.279314] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.365094] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.470631] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.471890] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.472018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.472464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bde05f6-7859-436d-95a2-f62e3675b65b with status ACTIVE [ 1079.472683] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.472849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.472954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.473177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.473268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.473511] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.473655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.473724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.473881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.473990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.477685] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.477913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.477953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.478173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.478890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.479067] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bde05f6-7859-436d-95a2-f62e3675b65b is going to be updated. [ 1079.502297] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.502487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.502487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.504408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.504408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.504408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bde05f6-7859-436d-95a2-f62e3675b65b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.782680] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.782803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.783018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.783228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.785119] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1079.785642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.807655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.807655] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.807655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.807655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.808879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.808879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.808879] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1079.840921] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.841125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.841171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.841370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.841549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.852512] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1079.869446] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.869446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.869446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.869446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.869446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.869446] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 is going to be updated. [ 1079.898934] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.898934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.898934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.898934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.898934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.908681] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: IN_PROGRESS for 2s [ 1079.975556] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.482102] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.482488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.482488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.482773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.482927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.483142] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1080.519163] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.520573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.520835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.521018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.521215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.532653] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1081.244408] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.244408] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.244408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.244408] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.246152] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: SUCCESS [ 1081.246372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.246567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.246769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.247047] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.247368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.247368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.247785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.247785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.247785] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.249868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.249868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.249868] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.249868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.249868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.249868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.249868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.249868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.249868] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.252043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.252043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.252043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.252043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.252043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.252043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.252043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.252817] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.512834] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e6c0d3f0-a6ea-4779-ac5d-261cc173801f None None] Enqueued Resource ID: d3754c8e-26a2-4543-8684-723e4d2a019f with Priority: HIGHEST for action port [ 1081.513414] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3754c8e-26a2-4543-8684-723e4d2a019f with Priority: HIGHEST for action port [ 1081.515749] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3754c8e-26a2-4543-8684-723e4d2a019f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.515896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3754c8e-26a2-4543-8684-723e4d2a019f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.516092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3754c8e-26a2-4543-8684-723e4d2a019f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.516371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3754c8e-26a2-4543-8684-723e4d2a019f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.516371] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3754c8e-26a2-4543-8684-723e4d2a019f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.751755] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.753477] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.753711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.753980] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.758885] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.865944] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1081.865944] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 1081.865944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.921565] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: SUCCESS [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.921565] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.921565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.921565] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.018415] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3754c8e-26a2-4543-8684-723e4d2a019f [ 1082.019069] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.019069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.019069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.019400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.019517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.019647] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3754c8e-26a2-4543-8684-723e4d2a019f already deleted. [ 1082.019786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3754c8e-26a2-4543-8684-723e4d2a019f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.258348] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.259389] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fc812c2-d9bf-4340-ac39-bbb8659329cc: rpc.has_security_group_logging(os_id): False [ 1082.260787] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.282031] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.282031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.282031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.282379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.282379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.282483] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.282568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.282644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.283612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.283612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.283612] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be created. [ 1082.347837] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.348108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.348257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.348607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.348880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.374157] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: IN_PROGRESS for 2s [ 1082.424586] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.545868] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1082.546186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.546765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.547012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.547217] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.547333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.547393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.547548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.547623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.547701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.547787] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.764239] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.764239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.764239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.764239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.764239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.764239] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1082.765654] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.765654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.765654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.765654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.766326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.766326] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be updated. [ 1082.807351] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.807525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.807619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.807863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.808030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.811487] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.811646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.811853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.812101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.812292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.824805] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: IN_PROGRESS for 2s [ 1082.825663] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1082.928079] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6: rpc.has_security_group_logging(os_id): False [ 1082.945819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.945999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.946085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.946390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.946390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.946614] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.948278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.948278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.948278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.948278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.948278] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 is going to be created. [ 1083.016021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.016021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.016021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.016021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.016021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.024661] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: IN_PROGRESS for 2s [ 1083.050893] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.050893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.051141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.051277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.051490] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.051616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.051685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.051882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.051985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.052067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.052206] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.052295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.052346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.052485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.052621] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.052710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.052824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.052897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.052983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.053077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.053165] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.067456] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e4d40237-9c94-4531-a195-d82e0ef081cd None None] Enqueued Resource ID: 8082780c-2c26-40cf-a79b-28734548650f with Priority: HIGHEST for action port [ 1083.068052] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8082780c-2c26-40cf-a79b-28734548650f with Priority: HIGHEST for action port [ 1083.068555] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-8082780c-2c26-40cf-a79b-28734548650f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.068555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8082780c-2c26-40cf-a79b-28734548650f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.068555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8082780c-2c26-40cf-a79b-28734548650f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.068823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8082780c-2c26-40cf-a79b-28734548650f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.068898] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8082780c-2c26-40cf-a79b-28734548650f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.555980] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6984856-6c1b-4d02-a5b7-08f98ac851be: rpc.has_security_group_logging(os_id): False [ 1083.574567] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.574709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.574777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.575461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.575461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.575461] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.575461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.575461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.575692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.575692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.575798] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.579019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.579019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1083.579019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8082780c-2c26-40cf-a79b-28734548650f [ 1083.579019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.579019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8082780c-2c26-40cf-a79b-28734548650f already deleted. [ 1083.579019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8082780c-2c26-40cf-a79b-28734548650f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.643536] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.643536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.643646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.644088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.644088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.659610] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1083.862498] env[69238]: INFO networking_nsxv3.common.synchronization [None req-401ee6b0-ed4e-43e7-acc1-bea067f1c930 None None] Enqueued Resource ID: b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3 with Priority: HIGHEST for action port [ 1083.863098] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3 with Priority: HIGHEST for action port [ 1083.865095] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.865095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.865095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.865294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.865400] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.982832] env[69238]: INFO networking_nsxv3.common.synchronization [None req-dd807ab7-4901-40c0-8290-11b96dddd398 tempest-ServersTestManualDisk-1014510655 tempest-ServersTestManualDisk-1014510655-project-member] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_rules [ 1083.983359] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_rules [ 1083.983784] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.983922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.983989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.984254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.984337] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.066464] env[69238]: INFO networking_nsxv3.common.synchronization [None req-8d939975-2461-4df9-ab55-bd75677e9118 tempest-ServersTestManualDisk-1014510655 tempest-ServersTestManualDisk-1014510655-project-member] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_rules [ 1084.066464] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_rules [ 1084.066464] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.066464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.371728] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3 [ 1084.371728] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.371958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.371958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.372113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.372171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.372267] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3 already deleted. [ 1084.372325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b93b5d6f-a8d7-4ae2-bd9d-bcae316023d3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.388374] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: SUCCESS [ 1084.388636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.388806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.389031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.389120] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.505174] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.505329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.505397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.505604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.505679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.505878] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 already deleted. [ 1084.505947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.506499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.506499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.506499] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.680087] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e84c627f-3a8a-406f-bfa3-2cd7897eff8e tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_rules [ 1084.680637] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_rules [ 1084.680963] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.681090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.681159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.681384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.681463] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.819165] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0bea336c-a170-4c5a-8de6-7c10008a6eca tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_rules [ 1084.819725] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_rules [ 1084.820044] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.820265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.840042] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1084.840042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.840712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.841083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.841842] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.841842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.841842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.841842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.841842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.843610] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.844065] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: SUCCESS [ 1084.844286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.844523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.844651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.845213] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.845213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.845213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.845213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.845442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.845442] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.894513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.894513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.031077] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.031077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.031077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.031077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.031077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.031077] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 already deleted. [ 1085.031077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.036265] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: SUCCESS [ 1085.036265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.201921] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.202156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.202258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.202507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.202634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.202795] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 already deleted. [ 1085.202925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.203159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.203371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.203480] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.351024] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.351024] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.488150] env[69238]: INFO networking_nsxv3.common.synchronization [None req-34f5573b-6c31-4906-9be4-97124492c455 None None] Enqueued Resource ID: cf4ae05e-0dfd-4be0-9138-bf878b329ff0 with Priority: HIGHEST for action port [ 1085.488150] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf4ae05e-0dfd-4be0-9138-bf878b329ff0 with Priority: HIGHEST for action port [ 1085.488150] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf4ae05e-0dfd-4be0-9138-bf878b329ff0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.488150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf4ae05e-0dfd-4be0-9138-bf878b329ff0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.488150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf4ae05e-0dfd-4be0-9138-bf878b329ff0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.488150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf4ae05e-0dfd-4be0-9138-bf878b329ff0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.488823] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf4ae05e-0dfd-4be0-9138-bf878b329ff0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.673613] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1085.673843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.726333] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.726702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.726702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.726939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.727046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.727246] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 already deleted. [ 1085.727373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.854010] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.855015] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.991986] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf4ae05e-0dfd-4be0-9138-bf878b329ff0 [ 1085.992108] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.992229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.992293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.992687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.992687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.992792] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf4ae05e-0dfd-4be0-9138-bf878b329ff0 already deleted. [ 1085.992792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf4ae05e-0dfd-4be0-9138-bf878b329ff0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.357554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.357746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.357791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.357992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.358096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.358200] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1086.361444] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.361654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.361654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.361837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.361915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.362011] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be updated. [ 1086.387392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.387579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.387669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.387851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.387993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.389900] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.390153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.390265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.390451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.390595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.403943] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: IN_PROGRESS for 2s [ 1086.404602] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1087.247392] env[69238]: INFO networking_nsxv3.common.synchronization [req-b903be2e-552e-49c1-a679-0b7105842738 req-b74093f6-d0dd-4772-a016-75dc1f2e6e16 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1087.248078] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1087.248435] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.248571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.248668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.248876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.252913] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.253556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.253556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.253556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.253556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.253758] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.558300] env[69238]: INFO networking_nsxv3.common.synchronization [req-35f59c71-0c87-46d7-8399-436531452b44 req-85325020-429d-4b47-9d4e-2c76a7aab60f tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1087.558300] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1087.558300] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.558300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.558300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.558300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.558300] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.558300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.558300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.558300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.558300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.559080] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.758727] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.758727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.758727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.758727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.758727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.758727] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.758727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.758727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.761737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.761737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.761737] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1087.790532] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.791138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.791283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.791535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.791702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.803929] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1087.884766] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.885144] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.885398] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.885758] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.886163] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.886403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.886589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.886891] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.887244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.887337] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.887606] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.887673] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.887798] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.887925] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.888048] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.888218] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.911402] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.911653] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1087.911810] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.912050] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.912402] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-8105a9e7-2237-438d-8649-83f9170d1186 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.912588] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.912763] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.913114] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.913287] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8105a9e7-2237-438d-8649-83f9170d1186',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.062159] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.062331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.062643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.062693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.062790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.063016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.063248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.063312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.063490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.063548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.063638] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1088.094705] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.094855] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.094931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.095144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.095286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.110226] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1088.414997] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: SUCCESS [ 1088.415364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.415824] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.416015] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.416141] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.416416] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.416613] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.416715] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 8105a9e7-2237-438d-8649-83f9170d1186 not found, creating... [ 1088.416979] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.417165] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.417282] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.417504] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.417648] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.417933] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.418108] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.418230] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.418506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.419184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.419184] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 8105a9e7-2237-438d-8649-83f9170d1186 is going to be created. [ 1088.419795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.419954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.420124] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.420224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.420287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.420460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.420543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.420628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.420714] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.422156] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1088.422340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.422548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.422648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.422796] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.422893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.422956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.423104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.423182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.423265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.423417] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.423508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.423565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.423701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.423835] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.423918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.423979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.424119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.424184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.424261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.424348] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.446359] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.446596] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.446685] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.447079] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.447332] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.447574] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.926316] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.927244] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe: rpc.has_security_group_logging(os_id): False [ 1088.949151] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.949294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.949381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.949570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.953026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.953026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.953026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.953026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.954173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.954173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.954173] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1089.014828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.015029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.015081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.015270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.015412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.028505] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1089.429194] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fc812c2-d9bf-4340-ac39-bbb8659329cc: rpc.has_security_group_logging(os_id): False [ 1089.433962] env[69238]: INFO networking_nsxv3.common.synchronization [req-b903be2e-552e-49c1-a679-0b7105842738 req-8c5c7b22-d532-413d-ae2e-5d34fd4947dc service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 1089.434201] env[69238]: INFO networking_nsxv3.common.synchronization [req-b903be2e-552e-49c1-a679-0b7105842738 req-8c5c7b22-d532-413d-ae2e-5d34fd4947dc service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1089.434423] env[69238]: INFO networking_nsxv3.common.synchronization [req-b903be2e-552e-49c1-a679-0b7105842738 req-8c5c7b22-d532-413d-ae2e-5d34fd4947dc service nova] Enqueued Resource ID: 8105a9e7-2237-438d-8649-83f9170d1186 with Priority: HIGHEST for action port [ 1089.437486] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 1089.437486] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1089.437486] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8105a9e7-2237-438d-8649-83f9170d1186 with Priority: HIGHEST for action port [ 1089.437486] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.437486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.437486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.437486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.437486] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.438662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.438662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.438662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-8105a9e7-2237-438d-8649-83f9170d1186 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.438905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.438905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.439493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.439493] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8105a9e7-2237-438d-8649-83f9170d1186',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.458550] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.458742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.458742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.458951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.459055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.459290] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.459389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.459453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.459629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.459701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.459777] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be updated. [ 1089.539552] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.539552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.539552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.539552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.539552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.554609] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: IN_PROGRESS for 2s [ 1089.816356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1089.816560] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 1089.816698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.816836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.817103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.817307] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.817450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.817519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.817672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.817748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.817840] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.941422] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.941638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.942932] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8105a9e7-2237-438d-8649-83f9170d1186 with status ACTIVE [ 1089.943154] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.943270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.943338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.943543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.943871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.944132] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.944244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.944324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.944510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.944575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.944786] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.944896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.945089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.945146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.945180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.945250] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8105a9e7-2237-438d-8649-83f9170d1186 is going to be updated. [ 1089.975770] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.976286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.976286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.976286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.976463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.976513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8105a9e7-2237-438d-8649-83f9170d1186" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.121677] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1090.121848] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 deletion is rescheduled due to dependency. [ 1090.122785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.322699] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.824031] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.043090] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1091.043417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.043666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.043958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.044095] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.326818] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.327019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.327101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.327304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.327395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.327534] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1091.362087] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.362304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.362417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.362725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.362891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.373321] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1091.547116] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.547280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.547352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.551017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.551017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.551017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.551017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.551017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.551017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.551017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.551017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.569473] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: SUCCESS [ 1091.570175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.054023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.054023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.054023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.054023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.054023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.054968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.054968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.054968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.054968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.054968] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.555410] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe: rpc.has_security_group_logging(os_id): False [ 1092.575803] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.575957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.576039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.576271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.576373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.576573] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.576678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.576741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.576902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.576978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.577195] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.577292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.577352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.577494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.577575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.577781] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.577870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.577922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.578081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.578157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.578245] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1092.647873] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.648104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.648104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.648225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.648400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.663336] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1093.385512] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1093.385512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.386039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.386039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.386336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.386460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.386628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.386789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.386927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.387086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.387239] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.890337] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.890567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.890567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.890799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.890933] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.891447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.891570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.891672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.891758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.891847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.891999] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.892103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.892163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.892300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.892433] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.892524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.892583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.892775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.892815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.892874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.892960] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.117421] env[69238]: INFO networking_nsxv3.common.synchronization [req-945d7e11-4ecf-4499-b94e-09fd78954735 req-1a8a0c2c-da09-4839-bcc2-79dc2cee1445 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1094.117421] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1094.117421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.117421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.117421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.118939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.118939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.118939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.118939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.119252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.119299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.119400] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.398117] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cd8a4c5-7d49-440a-bef6-697272c0d01d: rpc.has_security_group_logging(os_id): False [ 1094.421155] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.421916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.422081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.422386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.422543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.422983] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.423350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.423350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.423551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.423677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.424112] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.424282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.424383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.424664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.424664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.424910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.425090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.425185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.425371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.425551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.425603] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1094.507254] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.507254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.507254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.507254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.507254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.528482] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1094.621236] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.635367] env[69238]: INFO networking_nsxv3.common.synchronization [None req-b9773bfa-5afa-4d51-b2ce-78ae2047defc tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1094.636294] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1094.636664] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.636771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.682248] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1094.682489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.123820] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.626862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.627223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.627223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.627371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.627481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.627971] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1095.661292] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.661292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.661446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.661690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.661853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.677992] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1096.543969] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1096.544326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.816679] env[69238]: INFO networking_nsxv3.common.synchronization [req-63f1adfe-86f3-49b4-b847-ab5069d4520b req-9b41e483-9cf8-44a2-a74a-40433b6f46f6 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1096.817226] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1096.817553] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.817781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.817781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.817996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.818287] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.818413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.818509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.818696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.818810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.818921] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.321889] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.365311] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.365542] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.365623] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.365996] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.366373] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.366628] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.366763] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.367022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.369541] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.369863] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.369954] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.370065] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.370191] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.370372] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.370499] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.370679] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.401061] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.401285] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1097.401435] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.402201] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.402201] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.402201] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.402386] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.402618] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.407146] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e67a15b-4525-40ae-a4eb-6879f7bce5ff',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.686940] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1097.687177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.687382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.687550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.687733] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.687843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.687906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.688054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.688132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.688220] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.725216] env[69238]: INFO networking_nsxv3.common.synchronization [req-2c32d95c-4906-4680-b163-5457320c3ecf req-8fe5a196-3356-4e33-b5fa-8cc8fec2c5a9 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_members [ 1097.725216] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee with Priority: HIGHEST for action security_group_members [ 1097.725216] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.725653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.725889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.726252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.726541] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.726792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.726970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.727291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.727485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.727683] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a29c175-5acc-4d5c-b7f6-b89ab43280ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.823818] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.906209] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.906985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.906985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.906985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.906985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.907244] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 0e67a15b-4525-40ae-a4eb-6879f7bce5ff not found, creating... [ 1097.907395] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.907634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.907692] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.907914] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.908119] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.908430] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.908612] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.908738] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.909871] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.910634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.910867] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 0e67a15b-4525-40ae-a4eb-6879f7bce5ff is going to be created. [ 1097.935138] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.936947] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.936947] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.936947] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.936947] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.936947] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.196615] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.197084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.197206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.197452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.197597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.197843] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.197962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.198042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.198266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.198355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.198487] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1098.227579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.227794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.227846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.228245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.228470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.230023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.233385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.233500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.233661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.248119] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1098.259844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.260150] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.260308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.260386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.260592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.260674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.260766] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee is going to be updated. [ 1098.290409] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.290631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.290706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.291136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.291367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.299626] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee in Status: IN_PROGRESS for 2s [ 1098.326275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.326427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.326499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.326724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.326818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.326918] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1098.357343] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.357491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.357611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.357757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.357900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.367646] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1098.893736] env[69238]: INFO networking_nsxv3.common.synchronization [req-63f1adfe-86f3-49b4-b847-ab5069d4520b req-afd1ca63-b929-420a-bf6e-57d656e1cb15 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1098.894027] env[69238]: INFO networking_nsxv3.common.synchronization [req-63f1adfe-86f3-49b4-b847-ab5069d4520b req-afd1ca63-b929-420a-bf6e-57d656e1cb15 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1098.894027] env[69238]: INFO networking_nsxv3.common.synchronization [req-63f1adfe-86f3-49b4-b847-ab5069d4520b req-afd1ca63-b929-420a-bf6e-57d656e1cb15 service nova] Enqueued Resource ID: 0e67a15b-4525-40ae-a4eb-6879f7bce5ff with Priority: HIGHEST for action port [ 1098.894324] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1098.894595] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1098.894759] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e67a15b-4525-40ae-a4eb-6879f7bce5ff with Priority: HIGHEST for action port [ 1098.899263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.899263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.899263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.899263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.899263] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.903353] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.903479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.903728] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.903832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.903894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.904113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.904191] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e67a15b-4525-40ae-a4eb-6879f7bce5ff',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.408673] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.408795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.409099] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e67a15b-4525-40ae-a4eb-6879f7bce5ff with status ACTIVE [ 1099.409304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.409413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.409474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.409679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.409763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.409923] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.410031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.410093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.410238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.410950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.411387] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.411501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.411575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.411825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.412022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.412083] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e67a15b-4525-40ae-a4eb-6879f7bce5ff is going to be updated. [ 1099.436782] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.437035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.437140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.437420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.437561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.437792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e67a15b-4525-40ae-a4eb-6879f7bce5ff" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.258231] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1100.258711] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be deletion is rescheduled due to dependency. [ 1100.258711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.310561] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee in Status: SUCCESS [ 1100.311109] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a29c175-5acc-4d5c-b7f6-b89ab43280ee deletion is rescheduled due to dependency. [ 1100.311109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a29c175-5acc-4d5c-b7f6-b89ab43280ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.380810] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1100.380810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.380810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.381097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.381226] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.381475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.381475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.381591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.381625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.381888] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.885176] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.327869] env[69238]: INFO networking_nsxv3.common.synchronization [req-59d3c497-74ce-4d67-84a7-4b95f70bbf7c req-49c50bf5-2483-45ee-a1f4-6040041f9103 tempest-ServersTestManualDisk-1014510655 tempest-ServersTestManualDisk-1014510655-project-member] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_members [ 1101.328490] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_members [ 1101.328799] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.328915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.328977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.329775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.329775] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.330062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.330062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.330237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.330237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.330428] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.389146] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.690615] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.691079] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-393" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.691223] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-393" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.691589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-393" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.692319] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.692611] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.692822] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.693095] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.693266] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.693514] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.693641] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.693757] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.693870] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.694113] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.694113] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.694312] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.717452] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.717452] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1101.717452] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.717720] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-393" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.718319] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.718433] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.720551] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.720551] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.720551] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.733033] env[69238]: INFO networking_nsxv3.common.synchronization [None req-bd364244-1d41-40ba-9ad5-1b16b714462a None None] Enqueued Resource ID: 81ae00ac-face-4bef-943c-fbae7666d7b8 with Priority: HIGHEST for action port [ 1101.733184] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81ae00ac-face-4bef-943c-fbae7666d7b8 with Priority: HIGHEST for action port [ 1101.733571] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-81ae00ac-face-4bef-943c-fbae7666d7b8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.733636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81ae00ac-face-4bef-943c-fbae7666d7b8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.733698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81ae00ac-face-4bef-943c-fbae7666d7b8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.733948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81ae00ac-face-4bef-943c-fbae7666d7b8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.735912] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ae00ac-face-4bef-943c-fbae7666d7b8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.832448] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.832655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.832655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.832870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.832963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.833194] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.833358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.833438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.833604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.833681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.833771] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 already deleted. [ 1101.833853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.892215] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.892215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.892424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.892484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.892573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.892670] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1101.926062] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.926062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.926062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.926062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.926062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.936262] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1102.223916] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.224182] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.224329] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.224696] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.224945] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.225034] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c not found, creating... [ 1102.225251] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.225419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.225542] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.226080] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.226080] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.226235] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.227310] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.227310] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.227310] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.227310] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.227310] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c is going to be created. [ 1102.239640] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81ae00ac-face-4bef-943c-fbae7666d7b8 [ 1102.239859] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.240797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.240797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.240797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.240797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.240797] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81ae00ac-face-4bef-943c-fbae7666d7b8 already deleted. [ 1102.240797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81ae00ac-face-4bef-943c-fbae7666d7b8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.258495] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.258764] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.258904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.259202] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.259453] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.259700] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.039447] env[69238]: INFO networking_nsxv3.common.synchronization [req-59d3c497-74ce-4d67-84a7-4b95f70bbf7c req-2cad01d2-2392-4169-bc0b-e1a987316e0b service nova] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_rules [ 1103.039703] env[69238]: INFO networking_nsxv3.common.synchronization [req-59d3c497-74ce-4d67-84a7-4b95f70bbf7c req-2cad01d2-2392-4169-bc0b-e1a987316e0b service nova] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_members [ 1103.040693] env[69238]: INFO networking_nsxv3.common.synchronization [req-59d3c497-74ce-4d67-84a7-4b95f70bbf7c req-2cad01d2-2392-4169-bc0b-e1a987316e0b service nova] Enqueued Resource ID: 34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c with Priority: HIGHEST for action port [ 1103.040693] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_rules [ 1103.040693] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_members [ 1103.040693] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c with Priority: HIGHEST for action port [ 1103.042701] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.042882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.042957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.043251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.043376] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.044479] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.044615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.044798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.044959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.045265] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.045265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.045265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.046102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.048225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.048362] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.051211] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.051211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.051211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.051211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.051211] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.554537] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.554697] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.556133] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c with status ACTIVE [ 1103.556364] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.556592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.556695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.556914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.557010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.557205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.557310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.557367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.557502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.557696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.557770] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.557845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.557899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.558032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.558102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.558196] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c is going to be updated. [ 1103.561613] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.584426] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.584785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.584882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.585112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.585291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.585450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34d92cd1-3f92-4947-b1eb-f4ffbdd20e5c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.947980] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1103.948242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.949177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.949177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.949177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.949177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.949177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.949763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.949763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.949763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.949763] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.989860] env[69238]: INFO networking_nsxv3.common.synchronization [req-40de1c98-a57d-4e3b-afde-496468aa04bf req-54d5b636-81cb-414f-8ecb-26ed001b2e8f tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1103.990550] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1103.991136] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.991136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.991136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.991360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.991512] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.991608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.991659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.991800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.993788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.993788] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.002164] env[69238]: INFO networking_nsxv3.common.synchronization [None req-39ba9b4b-0b40-41c5-8284-bdb03f55ebd1 None None] Enqueued Resource ID: 6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855 with Priority: HIGHEST for action port [ 1104.002164] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855 with Priority: HIGHEST for action port [ 1104.002164] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.002164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.002164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.002164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.002420] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.063561] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.454600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.454758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.454827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.455070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.455243] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.455344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.455409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.455782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.455899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.456025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.456257] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.456330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.456380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.456525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.460837] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.461029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.461105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.461322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.461412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.461505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.461599] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.497444] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.497569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.497639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.497856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.497940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.498133] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.498223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.498312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.498463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.498534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.498616] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1104.505014] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855 [ 1104.505322] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.505457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.505525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.505719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.505804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.505902] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855 already deleted. [ 1104.505986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cfc9ede-6df7-4df1-8e4c-b89c1d0d9855" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.528667] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.530047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.530047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.530047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.530047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.544821] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1104.565652] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.567145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.567817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.570019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.570019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.570019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 is going to be created. [ 1104.598019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.598019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.598019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.598019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.598019] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.611283] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: UNINITIALIZED for 2s [ 1104.642298] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.642502] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.642652] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.642954] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.647170] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.647979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.647979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.647979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.648169] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.648357] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.649364] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.649364] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.649364] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.649364] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.649364] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.649364] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.670208] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.670208] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.670208] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.670208] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-604" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.670208] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-a39acdef-f524-4508-bd6a-294056960e3b taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.670208] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.670208] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.670735] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.670735] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a39acdef-f524-4508-bd6a-294056960e3b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.966332] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1104.985696] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.985862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.985973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.986269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.986386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.986611] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.986713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.986793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.986946] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.987040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.987204] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.987298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.987352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.987535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.987613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.987801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.987892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.987952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.988385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.988475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.988567] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1105.068755] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.068755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.068755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.068755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.068755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.090140] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1105.177140] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.177589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.177589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.177867] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.178059] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.178254] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port a39acdef-f524-4508-bd6a-294056960e3b not found, creating... [ 1105.178653] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.178801] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.178943] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.179261] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.179432] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.179799] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.179979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.180150] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.180441] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.180601] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.180759] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: a39acdef-f524-4508-bd6a-294056960e3b is going to be created. [ 1105.236996] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.236996] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.236996] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.237372] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.237608] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.237870] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.108596] env[69238]: INFO networking_nsxv3.common.synchronization [req-40de1c98-a57d-4e3b-afde-496468aa04bf req-5af4f818-cc0d-40f5-ae93-67781c1c4226 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 1106.108877] env[69238]: INFO networking_nsxv3.common.synchronization [req-40de1c98-a57d-4e3b-afde-496468aa04bf req-5af4f818-cc0d-40f5-ae93-67781c1c4226 service nova] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1106.109099] env[69238]: INFO networking_nsxv3.common.synchronization [req-40de1c98-a57d-4e3b-afde-496468aa04bf req-5af4f818-cc0d-40f5-ae93-67781c1c4226 service nova] Enqueued Resource ID: a39acdef-f524-4508-bd6a-294056960e3b with Priority: HIGHEST for action port [ 1106.110239] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_rules [ 1106.110434] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1106.110525] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a39acdef-f524-4508-bd6a-294056960e3b with Priority: HIGHEST for action port [ 1106.110934] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.111102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.111102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.111253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.111321] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.112945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.112945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.112945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a39acdef-f524-4508-bd6a-294056960e3b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.112945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.112945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.112945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.112945] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a39acdef-f524-4508-bd6a-294056960e3b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.322217] env[69238]: INFO networking_nsxv3.common.synchronization [req-8e44d8b5-b09b-40a3-9121-f38aa0702b8e req-330a787f-82ed-470f-95ad-3a0579583981 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1106.322217] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1106.322217] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.322217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.322217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.323014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.323406] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.323685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.323886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.324261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.324593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.324830] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.557052] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1106.557284] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 deletion is rescheduled due to dependency. [ 1106.557494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.557597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.557809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.557993] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.558131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.558217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.558379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.558464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.558574] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.615230] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a39acdef-f524-4508-bd6a-294056960e3b with status ACTIVE [ 1106.615461] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.615592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.615656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.615865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.615954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.616156] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.616257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.616318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.616465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.616538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.616715] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.616807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.616860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.617033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.617072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.617314] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a39acdef-f524-4508-bd6a-294056960e3b is going to be updated. [ 1106.618600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.618716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.622132] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: SUCCESS [ 1106.622434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.622684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.622965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.623245] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.623426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.623617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.623756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.623951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.624097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.624232] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.641508] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.641803] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.641987] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.642343] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.642688] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.643350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.643350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.643350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.643563] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.643849] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.644040] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.644202] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.644363] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.644530] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.644682] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.645333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.646893] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.648116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.648318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.648498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.648682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.648902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a39acdef-f524-4508-bd6a-294056960e3b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.669668] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.669668] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.669668] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.669668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.669668] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.669668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.669668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.669668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.669668] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.827762] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.828731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.828731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.828906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.830042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.830042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.830042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.830042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.830042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.830042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.830042] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1106.864206] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.864350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.864425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.864643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.864783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.874939] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1107.066441] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.107960] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1107.108275] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.128420] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.172831] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.172972] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.173129] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.173423] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.173593] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.173759] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 not found, creating... [ 1107.174040] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.174212] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.174333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.174571] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.174798] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.174997] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.175175] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.175296] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.175527] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.175657] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.175800] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 is going to be created. [ 1107.207017] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.207268] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.207426] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.207810] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.208075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.208329] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.568417] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.631411] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2cd8869-5f9f-4177-a677-855677a36a05: rpc.has_security_group_logging(os_id): False [ 1107.661857] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.662107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.662360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.662678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.662785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.663168] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.663418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.664431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.664431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.664431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.664431] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 is going to be created. [ 1107.748522] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.748775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.748896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.749266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.749571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.762486] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: IN_PROGRESS for 2s [ 1107.965502] env[69238]: INFO networking_nsxv3.common.synchronization [req-8e44d8b5-b09b-40a3-9121-f38aa0702b8e req-70a81610-d1b8-4428-b389-3eb775d6defa service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1107.965502] env[69238]: INFO networking_nsxv3.common.synchronization [req-8e44d8b5-b09b-40a3-9121-f38aa0702b8e req-70a81610-d1b8-4428-b389-3eb775d6defa service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1107.965502] env[69238]: INFO networking_nsxv3.common.synchronization [req-8e44d8b5-b09b-40a3-9121-f38aa0702b8e req-70a81610-d1b8-4428-b389-3eb775d6defa service nova] Enqueued Resource ID: 7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 with Priority: HIGHEST for action port [ 1107.966017] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1107.966017] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1107.969140] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 with Priority: HIGHEST for action port [ 1107.969140] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.969140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.969140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.969140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.969140] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.969140] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.969140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.969140] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.969140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.969140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.971492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.971540] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.071303] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.071504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.071574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.071787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.071876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.071973] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1108.100677] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.100887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.100972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.101216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.101397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.111437] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1108.473924] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.474291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.474291] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 with status ACTIVE [ 1108.474416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.475029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.475029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.475029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.475029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.475029] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.475297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.475297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.475372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.475410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.475572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.475665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.475726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.475859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.475955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.476012] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0 is going to be updated. [ 1108.496459] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.496633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.496633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.496731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.496846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.496995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d6b7549-4ea2-44c0-b3b1-40253cd2a3f0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.887279] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1108.887505] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1108.887681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.887917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.888244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.888522] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.888724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.888831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.889068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.889218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.889420] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.152181] env[69238]: INFO networking_nsxv3.common.synchronization [req-239f3e6c-21f0-49ac-8d2e-cf6a663c38d1 req-51d0a92c-d32c-41cb-9a76-1f6d08ee953d tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_members [ 1109.152181] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_members [ 1109.152181] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.152181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.152181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.152181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.152181] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.152181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.153095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.153095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.153095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.153095] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.391730] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.659670] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.660112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.660112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.661922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.661922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.661922] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.661922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.661922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.661922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.661922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.661922] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 already deleted. [ 1109.661922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.776563] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: SUCCESS [ 1109.776983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.897621] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.122205] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1110.122205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.122205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.122205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.122205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.122205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.122205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.122756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.122941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.123104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.123258] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.161145] env[69238]: INFO networking_nsxv3.common.synchronization [req-b44431bc-6e59-4998-9448-4f6ef8d45075 req-05254d49-5177-4169-b73f-ed93fa214c01 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1110.164178] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1110.164178] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.164178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.164178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.164178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.164178] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.164178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.164621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.164869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.165050] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.166232] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.297793] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.298031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.298163] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.298474] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.298754] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.298920] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.299054] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.299283] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.299436] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.299651] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.299769] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.299881] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.299994] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.300116] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.300279] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.300392] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.336355] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.336558] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.336706] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.337237] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.337446] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-c86d0015-1fae-42e2-a432-c31435c97138 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.337601] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.337758] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.338118] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.338268] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c86d0015-1fae-42e2-a432-c31435c97138',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.401949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.401949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.401949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.401949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.401949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.401949] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1110.446098] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.446365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.446482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.446723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.446884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.463143] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1110.627138] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.627433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.627433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.627770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.627986] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.628188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.628347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.628622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.628812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.629108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.629229] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.629301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.629357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.629572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.629865] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.629865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.629995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.630106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.630190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.630370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.630468] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.667241] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.840919] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.841174] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.841461] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.841623] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.841785] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.841943] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port c86d0015-1fae-42e2-a432-c31435c97138 not found, creating... [ 1110.842226] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.842403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.842508] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.842743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.842917] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.843232] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.843406] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.843530] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.843747] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.843896] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.844318] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: c86d0015-1fae-42e2-a432-c31435c97138 is going to be created. [ 1110.864157] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.864389] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.864565] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.864874] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.865126] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.865371] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.133587] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9df4a22-2e58-46f6-9dc8-bffb28401a54: rpc.has_security_group_logging(os_id): False [ 1111.164610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.164876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.164876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.165074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.165224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.165604] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.165604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.165604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.166090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.166090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.166935] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.167119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.167333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.167414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.167491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.167644] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.168179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.168179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.168179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.168179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.168920] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1111.169849] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.273742] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.273742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.273742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.273977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.274110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.294130] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1111.510904] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1111.510904] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1111.677198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.677198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.677198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.677198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.677198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.677198] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1111.711311] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.711662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.711775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.712099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.712395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.725899] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1111.778011] env[69238]: INFO networking_nsxv3.common.synchronization [req-239f3e6c-21f0-49ac-8d2e-cf6a663c38d1 req-434dc090-f5a7-4d21-8f04-abadaf207479 service nova] Enqueued Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_rules [ 1111.778316] env[69238]: INFO networking_nsxv3.common.synchronization [req-239f3e6c-21f0-49ac-8d2e-cf6a663c38d1 req-434dc090-f5a7-4d21-8f04-abadaf207479 service nova] Enqueued Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_members [ 1111.778559] env[69238]: INFO networking_nsxv3.common.synchronization [req-239f3e6c-21f0-49ac-8d2e-cf6a663c38d1 req-434dc090-f5a7-4d21-8f04-abadaf207479 service nova] Enqueued Resource ID: c86d0015-1fae-42e2-a432-c31435c97138 with Priority: HIGHEST for action port [ 1111.780581] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_rules [ 1111.780581] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_members [ 1111.780581] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86d0015-1fae-42e2-a432-c31435c97138 with Priority: HIGHEST for action port [ 1111.780581] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.780581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.780581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.780581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.780581] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.781541] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.781657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.781715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.782274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.782437] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.782565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.782645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.782850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.782936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.783047] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.784810] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c86d0015-1fae-42e2-a432-c31435c97138 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.784810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.784810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.785141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.785301] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c86d0015-1fae-42e2-a432-c31435c97138',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.287415] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.288551] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.288784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.289019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c86d0015-1fae-42e2-a432-c31435c97138 with status ACTIVE [ 1112.289278] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.289278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.289457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.289667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.289667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.289790] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.289869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.289930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.290176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.290176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.290426] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.290933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.290933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.291126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.291126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.291281] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c86d0015-1fae-42e2-a432-c31435c97138 is going to be updated. [ 1112.323586] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.323981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.323981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.324331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.324331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.324513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c86d0015-1fae-42e2-a432-c31435c97138" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.476516] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1112.476747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.476923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.477160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.477405] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.477530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.477657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.477836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.477922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.478025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.478219] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.789854] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.985027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.985027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.985027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.985027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.985027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.985958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.985958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.985958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.985958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.985958] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.296677] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.296919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.296919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.297235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.297235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.297381] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 is going to be created. [ 1113.318451] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1113.318782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.327815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.328139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.328264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.328688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.328870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.341387] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 in Status: UNINITIALIZED for 2s [ 1113.487060] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b42b8e-961a-4b49-a6b3-231d9a561dc5: rpc.has_security_group_logging(os_id): False [ 1113.506416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.506667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.506667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.506809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.506868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.507120] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.507289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.507289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.507585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.507682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.507916] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.508343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.508533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.508604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.508673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.509048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.509176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.509237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.509407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.509678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.509850] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1113.580996] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.581260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.581260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.581500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.581650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.596976] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1113.741022] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1113.741022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.746863] env[69238]: INFO networking_nsxv3.common.synchronization [req-fef3c6d1-fb46-4485-8ed5-477cfaabe082 req-03ff70ef-b509-4049-bd86-1065b8298818 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1113.747575] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1113.747905] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.748046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.748169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.748427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.748619] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.748883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.748957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.749218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.749318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.749418] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.154392] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.154681] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.154797] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.155198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.155459] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.155656] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.155789] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.156114] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.156302] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.156863] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.157054] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.157187] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.157412] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.157623] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.157822] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.158018] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.187205] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.190031] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.190031] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.190031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-74" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.190031] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-999da757-ad7c-4f4d-a065-9f6929717d7f taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.190031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.190031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.190031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.190031] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999da757-ad7c-4f4d-a065-9f6929717d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.252278] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.695136] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.695328] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.695931] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.696262] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.696425] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.696913] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 999da757-ad7c-4f4d-a065-9f6929717d7f not found, creating... [ 1114.697306] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.697664] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.697664] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.697956] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.698128] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.698441] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.698607] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.698774] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.699046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.699158] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.699306] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 999da757-ad7c-4f4d-a065-9f6929717d7f is going to be created. [ 1114.739587] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.739587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.739587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.739587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.739587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.739587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.756714] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.260481] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.260801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.260801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.260909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.260986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.261091] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1115.291680] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.291848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.291895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.292134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.292286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.303422] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1115.350577] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 in Status: SUCCESS [ 1115.350868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.351119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.351585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.351585] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.351760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.351814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.352021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.352166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.352290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.352413] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.425435] env[69238]: INFO networking_nsxv3.common.synchronization [req-fef3c6d1-fb46-4485-8ed5-477cfaabe082 req-4f0fcbba-ba81-4514-8bbb-f6187b54ce7a service nova] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1115.425668] env[69238]: INFO networking_nsxv3.common.synchronization [req-fef3c6d1-fb46-4485-8ed5-477cfaabe082 req-4f0fcbba-ba81-4514-8bbb-f6187b54ce7a service nova] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1115.425750] env[69238]: INFO networking_nsxv3.common.synchronization [req-fef3c6d1-fb46-4485-8ed5-477cfaabe082 req-4f0fcbba-ba81-4514-8bbb-f6187b54ce7a service nova] Enqueued Resource ID: 999da757-ad7c-4f4d-a065-9f6929717d7f with Priority: HIGHEST for action port [ 1115.425975] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1115.426109] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1115.426351] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 999da757-ad7c-4f4d-a065-9f6929717d7f with Priority: HIGHEST for action port [ 1115.426761] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.426881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.426946] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.427817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.427817] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.428254] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.428351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.428538] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-999da757-ad7c-4f4d-a065-9f6929717d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.428636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.428699] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.428864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.428925] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999da757-ad7c-4f4d-a065-9f6929717d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.612428] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1115.613231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.855053] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.933036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.933036] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 999da757-ad7c-4f4d-a065-9f6929717d7f with status ACTIVE [ 1115.933036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.933036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.933036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.933036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.933826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.933826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.933826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.933826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.933826] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 999da757-ad7c-4f4d-a065-9f6929717d7f is going to be updated. [ 1115.959321] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.959568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.959568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.959739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.959876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.960044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.357671] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4f8c658-0121-4451-aadb-f2f4c356e1b7: rpc.has_security_group_logging(os_id): False [ 1116.388033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.388033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.388033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.388033] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 is going to be created. [ 1116.465470] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.465774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.465873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.466173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.466437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.484388] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 in Status: IN_PROGRESS for 2s [ 1117.317838] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1117.318272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.318598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.320350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.320350] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.320350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.320350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.320350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.320350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.320350] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.824679] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.326847] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.497108] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 in Status: SUCCESS [ 1118.497343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.591224] env[69238]: INFO networking_nsxv3.common.synchronization [None req-20e3a45b-1756-44c8-8a4b-93e1ffd5931e tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1118.591812] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1118.592430] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.592650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.592757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.593053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.593172] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.676448] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e2d440b2-7c1a-4deb-ab7a-8325a3c7e46f tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1118.676695] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1118.677050] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.677161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.831756] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.831756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.831756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.831756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.831756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.831756] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1118.860879] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.860879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.860879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.860879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.860879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.870364] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1119.119058] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.119058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.119058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.119058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.119058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.119058] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 already deleted. [ 1119.119058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.119058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.119627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.119627] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.643206] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.643357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.643443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.643755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.643880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.644011] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 already deleted. [ 1119.644130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.164184] env[69238]: INFO networking_nsxv3.common.synchronization [req-22b44ee0-8777-46bd-a05f-105b6901af1f req-96210fe4-e1fa-4f15-b6ab-4965f5df5e94 tempest-ServerTagsTestJSON-262538450 tempest-ServerTagsTestJSON-262538450-project-member] Enqueued Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_members [ 1120.165785] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_members [ 1120.165785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.165785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.165785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.165785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.165785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.166245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.166245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.167149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.167237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.167340] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.525503] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.525716] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-509" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.525870] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-509" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.526249] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-509" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.526519] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.526761] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.526968] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.527263] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.527439] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.527676] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.527795] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.527914] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.528072] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.528242] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.528361] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.528500] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.550869] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.551053] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1120.551194] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.551468] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-509" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.551779] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-d81ed41d-083c-400c-8117-fa6a6121d903 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.551946] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.552084] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.552463] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.552637] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81ed41d-083c-400c-8117-fa6a6121d903',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.669965] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.670208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.670296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.671160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.671160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.671160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.671160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.671160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.671160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.671160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.671751] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 already deleted. [ 1120.671751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.881486] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1120.881723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.881897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.882232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.882592] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.882691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.883021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.883066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.883231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.883336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.883483] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.054713] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.058021] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port d81ed41d-083c-400c-8117-fa6a6121d903 not found, creating... [ 1121.058021] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.058021] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.058498] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.058498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.058498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.058498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.058498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.058498] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: d81ed41d-083c-400c-8117-fa6a6121d903 is going to be created. [ 1121.091627] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.091899] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.092036] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.092365] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.092617] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.092850] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.386920] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.386920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.386920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.387586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.387586] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.387586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.387586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.387586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.387816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.387816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.388755] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.388755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.388755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.388755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.388755] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.388755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.388755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.388755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.388755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.393399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.393399] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.788375] env[69238]: INFO networking_nsxv3.common.synchronization [req-22b44ee0-8777-46bd-a05f-105b6901af1f req-c0612d48-dd9e-4ea4-816f-5dcf70f75d3b service nova] Enqueued Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_rules [ 1121.788375] env[69238]: INFO networking_nsxv3.common.synchronization [req-22b44ee0-8777-46bd-a05f-105b6901af1f req-c0612d48-dd9e-4ea4-816f-5dcf70f75d3b service nova] Enqueued Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_members [ 1121.788506] env[69238]: INFO networking_nsxv3.common.synchronization [req-22b44ee0-8777-46bd-a05f-105b6901af1f req-c0612d48-dd9e-4ea4-816f-5dcf70f75d3b service nova] Enqueued Resource ID: d81ed41d-083c-400c-8117-fa6a6121d903 with Priority: HIGHEST for action port [ 1121.789327] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_rules [ 1121.789327] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_members [ 1121.789327] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81ed41d-083c-400c-8117-fa6a6121d903 with Priority: HIGHEST for action port [ 1121.789932] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.789932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.789932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.793186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.793287] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.794273] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.794523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.794523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.794757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.795229] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.795229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.795229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.795378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.795378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.795461] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.796326] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d81ed41d-083c-400c-8117-fa6a6121d903 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.796410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.796521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.796626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.796702] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81ed41d-083c-400c-8117-fa6a6121d903',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.890792] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe: rpc.has_security_group_logging(os_id): False [ 1121.910659] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.910809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.910880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.911110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.911250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.911458] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.911568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.911639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.911776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.911868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.912076] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.912192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.912268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.912464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.912464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.912662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.912749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.912818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.912964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.913522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.913657] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1121.978863] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.979081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.979081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.979292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.979437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.998262] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1122.303997] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.305719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.305719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.305719] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d81ed41d-083c-400c-8117-fa6a6121d903 with status ACTIVE [ 1122.305719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.305719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.305719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.305719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.305719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.305719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.305719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.305719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.306647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.306647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.307966] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.307966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.307966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.307966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.307966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.307966] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d81ed41d-083c-400c-8117-fa6a6121d903 is going to be updated. [ 1122.334841] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.334841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.334841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.335066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.335213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.335383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d81ed41d-083c-400c-8117-fa6a6121d903" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.810444] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.313488] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.313713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.313713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.313932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.314041] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.314144] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 is going to be created. [ 1123.345561] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.345967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.345967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.345967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.346148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.358951] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 in Status: UNINITIALIZED for 2s [ 1124.017811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1124.018173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.303635] env[69238]: INFO networking_nsxv3.common.synchronization [req-d070a311-0cb8-459a-b119-f2c990334553 req-09a06f81-95e4-41eb-bc50-d105a8e31fda tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1125.303932] env[69238]: INFO networking_nsxv3.common.synchronization [req-d070a311-0cb8-459a-b119-f2c990334553 req-09a06f81-95e4-41eb-bc50-d105a8e31fda tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1125.304449] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1125.304610] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1125.305391] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.305391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.305391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.347017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.347017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.347017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.347017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.347017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.347017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.370711] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 in Status: SUCCESS [ 1125.370928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.371102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.371374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.371595] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.371723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.371790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.371943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.372033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.372119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.372209] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.383812] env[69238]: INFO networking_nsxv3.common.synchronization [req-d070a311-0cb8-459a-b119-f2c990334553 req-09a06f81-95e4-41eb-bc50-d105a8e31fda tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_rules [ 1125.384017] env[69238]: INFO networking_nsxv3.common.synchronization [req-d070a311-0cb8-459a-b119-f2c990334553 req-09a06f81-95e4-41eb-bc50-d105a8e31fda tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1125.384174] env[69238]: INFO networking_nsxv3.common.synchronization [req-d070a311-0cb8-459a-b119-f2c990334553 req-09a06f81-95e4-41eb-bc50-d105a8e31fda tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1125.384319] env[69238]: INFO networking_nsxv3.common.synchronization [req-d070a311-0cb8-459a-b119-f2c990334553 req-09a06f81-95e4-41eb-bc50-d105a8e31fda tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1125.384455] env[69238]: INFO networking_nsxv3.common.synchronization [req-d070a311-0cb8-459a-b119-f2c990334553 req-09a06f81-95e4-41eb-bc50-d105a8e31fda tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 999da757-ad7c-4f4d-a065-9f6929717d7f with Priority: HIGHEST for action port [ 1125.384950] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_rules [ 1125.390771] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1125.390771] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 999da757-ad7c-4f4d-a065-9f6929717d7f with Priority: HIGHEST for action port [ 1125.390771] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1125.390771] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1125.390771] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.390771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.390771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.390771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.390771] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.390771] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.390771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.390771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.390771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.391384] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.392672] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-999da757-ad7c-4f4d-a065-9f6929717d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.393178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.393336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.393590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.393730] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999da757-ad7c-4f4d-a065-9f6929717d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.394958] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.395166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.395454] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.396062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.808554] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.813736] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.876390] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.876648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.876705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.876885] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.877121] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.877343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.877343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.877496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.877589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.877678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.877943] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.877943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.878146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.878146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.878618] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.878730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.878766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.878892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.878993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.879072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.879285] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.897202] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 999da757-ad7c-4f4d-a065-9f6929717d7f with status ACTIVE [ 1125.897448] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.897680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.897680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.897987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.898133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.898318] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.898434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.898497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.898658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.898736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.898924] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.899046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.899121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.899249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.899413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.899519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 999da757-ad7c-4f4d-a065-9f6929717d7f is going to be updated. [ 1125.900869] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.900963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.901883] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.901883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.926851] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.926851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.927883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.927883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.927883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.927883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.311879] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.320881] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.382518] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6: rpc.has_security_group_logging(os_id): False [ 1126.401483] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.401620] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.401685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.401947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.402070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.402289] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.402416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.402459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.402642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.402724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.402908] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.403013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.403074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.403212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.403285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.403489] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.403584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.403648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.403789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.403862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.403946] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 is going to be created. [ 1126.473143] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.473297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.473365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.473654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.473881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.487425] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 in Status: IN_PROGRESS for 2s [ 1126.814156] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.814338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.814385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.814595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.814687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.814783] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1126.824851] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.824918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.824946] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.825165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.825258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.825375] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 is going to be created. [ 1126.851065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.851223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.853058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.853058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.853058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.854179] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.854329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.854430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.854667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.854872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.866061] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1126.867290] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: UNINITIALIZED for 2s [ 1128.484258] env[69238]: INFO networking_nsxv3.common.synchronization [req-65a6d865-0b5c-4089-8c5a-c734fbd465b2 req-64b00c02-5640-4445-a57f-459a60fd0220 tempest-ImagesTestJSON-1500869159 tempest-ImagesTestJSON-1500869159-project-member] Enqueued Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1128.485534] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 with Priority: HIGHEST for action security_group_members [ 1128.485752] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9df4a22-2e58-46f6-9dc8-bffb28401a54 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.485871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.485910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.486134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.486298] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.486403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.486467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.486618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.486706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.486800] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9df4a22-2e58-46f6-9dc8-bffb28401a54',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.498979] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 in Status: SUCCESS [ 1128.499248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.881112] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1128.881112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.881297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.881552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.881820] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.881967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.882054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.882246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.882331] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.882485] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.884078] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: SUCCESS [ 1128.884277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.884435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.884723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.884836] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.884949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.885024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.885192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.885274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.885414] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.990514] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.990709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.990709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.991082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.991252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.991570] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.991744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.991832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.992073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.992179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.992292] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 is going to be updated. [ 1129.036057] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.036057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.036057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.036496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.036720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.051114] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: IN_PROGRESS for 2s [ 1129.388102] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.388960] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.890498] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.891627] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.394245] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.394436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.394547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.394824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.395017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.395144] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1130.396712] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.396859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.396929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.397137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.397198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.397336] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 is going to be updated. [ 1130.442127] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.442285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.442395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.442747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.443571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.445181] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.445368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.445452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.445687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.445862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.456811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1130.457956] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: IN_PROGRESS for 2s [ 1131.066275] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 in Status: SUCCESS [ 1131.066622] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9df4a22-2e58-46f6-9dc8-bffb28401a54 deletion is rescheduled due to dependency. [ 1131.066695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9df4a22-2e58-46f6-9dc8-bffb28401a54" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.675763] env[69238]: INFO networking_nsxv3.common.synchronization [req-b8f0b8a0-9fcb-4ce3-ace7-c7057a5e9fde req-01a02756-193f-4aed-a018-16a8ab288ada tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1131.676331] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1131.676648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.676845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.676961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.679365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.679600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.679673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.679740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.679949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.680049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.680184] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.934658] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_members [ 1131.934658] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1131.934658] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1131.934837] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_members [ 1131.935287] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1131.935461] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1131.936457] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d801453-d38c-4846-b519-7d30551c5961 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.936457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.936457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.936457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.936457] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.936873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.936873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.937050] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.937124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.937242] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.938482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.938482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.938601] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.938683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.985323] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_rules [ 1131.985526] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_members [ 1131.985669] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_rules [ 1131.985802] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1131.985959] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1131.986160] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1131.986310] env[69238]: INFO networking_nsxv3.common.synchronization [req-6bdeeba0-5106-4f50-bdba-d2a48c05908f req-d9a636b3-fe20-46a7-b2f1-0dbc7df1e33d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 999da757-ad7c-4f4d-a065-9f6929717d7f with Priority: HIGHEST for action port [ 1131.986826] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_rules [ 1131.987136] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_rules [ 1131.987479] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1131.987602] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 999da757-ad7c-4f4d-a065-9f6929717d7f with Priority: HIGHEST for action port [ 1131.987727] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_rules [ 1131.987775] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_members [ 1131.987856] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1131.988193] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d801453-d38c-4846-b519-7d30551c5961 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.988341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.988411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.988684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.988767] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.989693] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.989775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.989940] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.990035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.990260] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-999da757-ad7c-4f4d-a065-9f6929717d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.990406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.990490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.990736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.991814] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999da757-ad7c-4f4d-a065-9f6929717d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.993057] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.993179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.995134] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d801453-d38c-4846-b519-7d30551c5961 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.995134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.995134] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.995134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.182800] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.183152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.183152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.183247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.183346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.183536] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.183659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.183733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.183831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.183925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.183991] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1132.245309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.245573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.245573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.245792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.245920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.258520] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1132.440885] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.473216] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1132.473576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.474145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.475147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.475147] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.475147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.475147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.475147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.475147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.475690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.475690] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.477449] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: SUCCESS [ 1132.477449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.477449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.481397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.481397] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.481397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.481397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.481562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.481562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.481731] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.482714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.482714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.482890] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.482939] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.483039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.483325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.483416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.483502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.483589] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.484564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.484717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.484866] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.484961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.485032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.485167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.485237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.485317] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.495192] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d801453-d38c-4846-b519-7d30551c5961 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.495383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.495941] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 999da757-ad7c-4f4d-a065-9f6929717d7f with status ACTIVE [ 1132.496134] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.496243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.496308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.496507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.496585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.497073] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.497214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.497276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.497441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.497520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.497785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.497923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.497995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.498382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.498706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.498706] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 999da757-ad7c-4f4d-a065-9f6929717d7f is going to be updated. [ 1132.523080] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.523288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.523471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.523664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.523860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.524146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-999da757-ad7c-4f4d-a065-9f6929717d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.945432] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.980445] env[69238]: INFO networking_nsxv3.common.synchronization [req-631a3374-9cbb-4a61-b72a-4c3a0eb9d917 req-d0a5ef8e-13a5-443e-8b27-94553058954c tempest-ServerTagsTestJSON-262538450 tempest-ServerTagsTestJSON-262538450-project-member] Enqueued Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_members [ 1132.980445] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGHEST for action security_group_members [ 1132.980445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.980445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.980445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.980445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.980445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.980445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.980445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.980445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.980445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.980445] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.985023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.985023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.986028] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.986744] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.993311] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.447591] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.447886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.447886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.448121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.448252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.448372] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d801453-d38c-4846-b519-7d30551c5961 is going to be created. [ 1133.474163] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.474371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.474371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.474690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.474862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.482691] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.482878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.482954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.483281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.483417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.483645] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.483784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.483859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.484032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.484113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.484205] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 is going to be updated. [ 1133.487637] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d801453-d38c-4846-b519-7d30551c5961 in Status: UNINITIALIZED for 2s [ 1133.487846] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.492796] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3edf3d8-ddf9-45c7-b69a-b33540726ef6: rpc.has_security_group_logging(os_id): False [ 1133.493795] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.514178] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.514402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.514466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.515374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.515374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.515374] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.515374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.515374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.515374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.515706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.515706] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 is going to be created. [ 1133.517311] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.517468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.517582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.517729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.517859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.527887] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 in Status: IN_PROGRESS for 2s [ 1133.580299] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.580499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.580608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.580787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.580961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.592505] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: IN_PROGRESS for 2s [ 1133.990554] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.990706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.990776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.990991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.991142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.991257] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1133.998032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.998206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.998274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.998457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.998575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.998681] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 is going to be updated. [ 1134.035202] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.035202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.035202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.035202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.035202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.037030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.037178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.037178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.037330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.037455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.048397] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1134.049180] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: IN_PROGRESS for 2s [ 1134.161332] env[69238]: INFO networking_nsxv3.common.synchronization [req-3dd27da9-59c5-4dfd-bc66-3d7b8d52ce10 req-c1c2f457-e011-4364-a62d-47b6436b5589 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1134.161491] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1134.161800] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.161923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.162158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.162406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.162567] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.162671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.162733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.162877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.162959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.163062] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.269952] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1134.269952] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1134.269952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.574266] env[69238]: INFO networking_nsxv3.common.synchronization [req-485af004-23ec-4013-82ea-55b5d381f4e8 req-77bcf455-872d-47e5-9b94-a07491c0492d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_members [ 1134.574266] env[69238]: INFO networking_nsxv3.common.synchronization [req-485af004-23ec-4013-82ea-55b5d381f4e8 req-77bcf455-872d-47e5-9b94-a07491c0492d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1134.574266] env[69238]: INFO networking_nsxv3.common.synchronization [req-485af004-23ec-4013-82ea-55b5d381f4e8 req-77bcf455-872d-47e5-9b94-a07491c0492d tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1134.574266] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d801453-d38c-4846-b519-7d30551c5961 with Priority: HIGHEST for action security_group_members [ 1134.574266] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1134.574266] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 with Priority: HIGHEST for action security_group_members [ 1134.575664] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d801453-d38c-4846-b519-7d30551c5961 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.575840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.576219] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.580071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.580071] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.580071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.665359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.665359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.665505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.666907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.666907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.666907] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.666907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.666907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.666907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.666907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.666907] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 already deleted. [ 1134.666907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.801444] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.801672] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.801971] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.802061] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.802353] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.802552] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.802682] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.803263] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.803770] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.804297] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.804446] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.804758] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.804903] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.805047] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.805159] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.805306] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.833392] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.833655] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1134.833741] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.833938] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.834307] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-6bd282fb-e377-40b9-849b-c0a0267848ba taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.834496] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.834618] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.834975] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.838273] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bd282fb-e377-40b9-849b-c0a0267848ba',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.340514] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.340752] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.340881] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.341259] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.341396] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.341611] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 6bd282fb-e377-40b9-849b-c0a0267848ba not found, creating... [ 1135.341895] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.342074] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.342198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.342427] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.342571] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.343063] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.343270] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.343379] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.343603] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.343753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.343901] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 6bd282fb-e377-40b9-849b-c0a0267848ba is going to be created. [ 1135.364724] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.365035] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.365189] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.365475] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.365707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.365930] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.499553] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d801453-d38c-4846-b519-7d30551c5961 in Status: SUCCESS [ 1135.499935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.500311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.500641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.500947] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.501184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.501305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.501580] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.501723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.501882] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.544208] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 in Status: SUCCESS [ 1135.544419] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 deletion is rescheduled due to dependency. [ 1135.544562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.605700] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: SUCCESS [ 1135.606082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.606142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.606368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.606456] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.004556] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.004759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.004796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.004982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.005098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.005319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.005420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.005484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.005638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.005716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.005801] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d801453-d38c-4846-b519-7d30551c5961 is going to be deleted. [ 1136.038875] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.039034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.039087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.039292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.039408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.039484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.039635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.039778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.039939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.040060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.040153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.040319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.040388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.040501] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.059525] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 in Status: SUCCESS [ 1136.059721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.059926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.060216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.060427] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.060554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.060611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.060780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.060862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.060972] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.062658] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1136.062833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.062987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.063178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.063344] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.063575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.063575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.063693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.063758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.063847] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.122018] env[69238]: INFO networking_nsxv3.common.synchronization [req-3dd27da9-59c5-4dfd-bc66-3d7b8d52ce10 req-644356c7-9cf9-4702-916f-d032d5a208e9 service nova] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1136.122215] env[69238]: INFO networking_nsxv3.common.synchronization [req-3dd27da9-59c5-4dfd-bc66-3d7b8d52ce10 req-644356c7-9cf9-4702-916f-d032d5a208e9 service nova] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1136.122361] env[69238]: INFO networking_nsxv3.common.synchronization [req-3dd27da9-59c5-4dfd-bc66-3d7b8d52ce10 req-644356c7-9cf9-4702-916f-d032d5a208e9 service nova] Enqueued Resource ID: 6bd282fb-e377-40b9-849b-c0a0267848ba with Priority: HIGHEST for action port [ 1136.122990] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1136.123146] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1136.123245] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bd282fb-e377-40b9-849b-c0a0267848ba with Priority: HIGHEST for action port [ 1136.123525] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.123651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.123718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.123922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.124009] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.124892] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.125036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.125079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.125251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.125396] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.125491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.125550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.125682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.125767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.125859] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.126660] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bd282fb-e377-40b9-849b-c0a0267848ba taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.126790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.126832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.126967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.127050] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bd282fb-e377-40b9-849b-c0a0267848ba',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.150284] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.150478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.150591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.150752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.150848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.150954] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 is going to be deleted. [ 1136.238418] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.238418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.238531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.238743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.238843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.238958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.547070] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.547070] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.547070] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d801453-d38c-4846-b519-7d30551c5961 already deleted. [ 1136.547070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.547070] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.548585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.548880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.549272] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.549499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.551179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.551179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.551179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.551179] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.569132] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.569132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.569132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.569565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.569794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.570177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.572020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.572020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.572020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.572020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.572020] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 is going to be deleted. [ 1136.572648] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.606036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.606036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.606036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.606036] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3edf3d8-ddf9-45c7-b69a-b33540726ef6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.628899] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.630071] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.630071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.630301] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bd282fb-e377-40b9-849b-c0a0267848ba with status ACTIVE [ 1136.630343] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.630473] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.631435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.631435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.631435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.631435] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.631435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.631435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.631435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.631435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.631734] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.632162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.632309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.632439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.632528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.632637] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bd282fb-e377-40b9-849b-c0a0267848ba is going to be updated. [ 1136.652625] env[69238]: INFO networking_nsxv3.common.synchronization [req-74e35a62-8969-47b1-848d-5610bc2fa20d req-e06ba075-4f73-4d88-a927-959431ce41a2 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1136.652860] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1136.653174] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.653297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.653365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.653561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.653702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.653792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.653851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.653988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.654087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.654176] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.657958] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.658152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.658237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.658486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.658640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.658802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bd282fb-e377-40b9-849b-c0a0267848ba" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.011546] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.011804] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.011953] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.012274] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.012524] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.012784] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.012868] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.013107] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.013261] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.013477] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.013595] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.013707] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.013821] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.013936] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.014060] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.014226] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.039078] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.039277] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1137.039494] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.039603] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.039937] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-270f84af-4525-4162-8823-8cfef482389f taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.040158] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.040293] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.040636] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.040779] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('270f84af-4525-4162-8823-8cfef482389f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.052198] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.052352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.052421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.052635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.052742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.052962] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.053105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.053159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.053298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.053377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.053466] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d801453-d38c-4846-b519-7d30551c5961 already deleted. [ 1137.053811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.053811] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d801453-d38c-4846-b519-7d30551c5961',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.074989] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.110426] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.110577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.110649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.110878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.110984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.111214] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.111333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.111392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.111551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.111626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.111712] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3edf3d8-ddf9-45c7-b69a-b33540726ef6 already deleted. [ 1137.111788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3edf3d8-ddf9-45c7-b69a-b33540726ef6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.135844] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.156631] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.542972] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.543239] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.543391] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.543725] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.543854] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.544028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 270f84af-4525-4162-8823-8cfef482389f not found, creating... [ 1137.544300] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.544463] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.544585] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.544880] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.545048] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.545345] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.545679] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.545845] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.546080] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.546230] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.546378] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 270f84af-4525-4162-8823-8cfef482389f is going to be created. [ 1137.556382] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d801453-d38c-4846-b519-7d30551c5961: rpc.has_security_group_logging(os_id): False [ 1137.567545] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.567760] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.567893] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.568234] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.568600] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.568716] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.573303] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.573440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.573480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.573670] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.573754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.573969] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.574087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.574147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.574300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.574376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.574460] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d801453-d38c-4846-b519-7d30551c5961 is going to be created. [ 1137.577095] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.577210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.577262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.577423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.577503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.577589] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1137.593673] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/2d801453-d38c-4846-b519-7d30551c5961], does not exist path=[/infra/domains/default/groups/2d801453-d38c-4846-b519-7d30551c5961]."\n}' [ 1137.593853] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d801453-d38c-4846-b519-7d30551c5961 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2d801453-d38c-4846-b519-7d30551c5961 [ 1137.593918] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1137.612078] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.612463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.612463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.612525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.612675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.623370] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1137.639227] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.639415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.639491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.639721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.639817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.639919] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be created. [ 1137.659090] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.675067] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.675067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.675067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.675201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.675333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.685689] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.685835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.685905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.686155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.687434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.687741] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.687923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.687923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.688110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.688168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.688403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.689873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.689873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.689873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.689873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.689873] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d801453-d38c-4846-b519-7d30551c5961 is going to be created. [ 1137.690769] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: UNINITIALIZED for 2s [ 1137.715639] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/2d801453-d38c-4846-b519-7d30551c5961], does not exist path=[/infra/domains/default/groups/2d801453-d38c-4846-b519-7d30551c5961]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2d801453-d38c-4846-b519-7d30551c5961 [ 1137.715815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d801453-d38c-4846-b519-7d30551c5961" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.716035] env[69238]: Traceback (most recent call last): [ 1137.716073] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1137.716073] env[69238]: return func(*args, **kwargs) [ 1137.716073] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1137.716073] env[69238]: res.raise_for_status() [ 1137.716073] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1137.716073] env[69238]: raise HTTPError(http_error_msg, response=self) [ 1137.716073] env[69238]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2d801453-d38c-4846-b519-7d30551c5961 [ 1137.716073] env[69238]: During handling of the above exception, another exception occurred: [ 1137.716073] env[69238]: Traceback (most recent call last): [ 1137.716272] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1137.716272] env[69238]: listener.cb(fileno) [ 1137.716272] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1137.716272] env[69238]: result = function(*args, **kwargs) [ 1137.716272] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1137.716272] env[69238]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1137.716272] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1137.716272] env[69238]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1137.716272] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1137.716272] env[69238]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1137.716272] env[69238]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1137.716272] env[69238]: res.raise_for_status() [ 1137.716272] env[69238]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1137.716272] env[69238]: raise HTTPError(http_error_msg, response=self) [ 1137.716272] env[69238]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2d801453-d38c-4846-b519-7d30551c5961 [ 1137.716272] env[69238]: Removing descriptor: 62 [ 1138.164012] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.164012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.164242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.164414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.164547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.164692] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1138.229638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.229813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.229880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.230676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.230676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.244612] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1138.421978] env[69238]: INFO networking_nsxv3.common.synchronization [req-74e35a62-8969-47b1-848d-5610bc2fa20d req-d0a66695-516b-4795-aa2c-eb7f5d17e55f service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1138.422300] env[69238]: INFO networking_nsxv3.common.synchronization [req-74e35a62-8969-47b1-848d-5610bc2fa20d req-d0a66695-516b-4795-aa2c-eb7f5d17e55f service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1138.422628] env[69238]: INFO networking_nsxv3.common.synchronization [req-74e35a62-8969-47b1-848d-5610bc2fa20d req-d0a66695-516b-4795-aa2c-eb7f5d17e55f service nova] Enqueued Resource ID: 270f84af-4525-4162-8823-8cfef482389f with Priority: HIGHEST for action port [ 1138.423159] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1138.423342] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1138.423484] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 270f84af-4525-4162-8823-8cfef482389f with Priority: HIGHEST for action port [ 1138.423857] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.423995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.424084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.424304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.424385] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.425304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.425426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.425642] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-270f84af-4525-4162-8823-8cfef482389f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.425748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.425824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.425992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.426096] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('270f84af-4525-4162-8823-8cfef482389f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.929651] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.929955] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.929955] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 270f84af-4525-4162-8823-8cfef482389f with status ACTIVE [ 1138.930258] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.930350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.930350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.930545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.930631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.930799] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.930894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.930957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.931122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.931201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.931374] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.931465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.931525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.931655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.931727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.931825] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 270f84af-4525-4162-8823-8cfef482389f is going to be updated. [ 1138.957033] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.957033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.957033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.957232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.957338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.957476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-270f84af-4525-4162-8823-8cfef482389f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.207468] env[69238]: INFO networking_nsxv3.common.synchronization [req-e5d18d4c-cead-47aa-a93c-a07a41c48cb3 req-50f9e9a9-b8c6-4c64-ad84-a2d051ebc9be tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1139.208020] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1139.209361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.209521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.209597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.209795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.209955] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.210077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.210172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.210316] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.210400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.210683] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.633519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1139.633761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.633929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.634165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.634358] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.634475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.634567] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.634687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.634763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.634846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.634996] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.635084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.635153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.635289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.635424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.635512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.635568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.635698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.635769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.635846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.635929] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.636878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.637053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.637197] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.637301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.637364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.637519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.637626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.637713] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.704443] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1139.704671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.704837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.705148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.705302] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.705423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.705487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.705641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.705794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.705852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.705919] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.712654] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.712836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.712900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.713094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.734837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.735103] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.735211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.735281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.735481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.735557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.735650] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 1139.767114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.767380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.767380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.767813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.768010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.778423] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1139.949419] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.949796] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.949796] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.950120] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.950765] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.950765] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.950765] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.951096] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.952011] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.952011] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.952011] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.952151] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.952233] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.952759] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.952881] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.953038] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.974394] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.974741] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.974971] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.975197] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-446" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.977262] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.977262] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.977262] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.977262] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.977262] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d97e4cea-5fb2-44c5-8349-e2aad8a3381f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.140769] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe: rpc.has_security_group_logging(os_id): False [ 1140.142042] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.163619] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.163619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.163619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.163794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.185198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.185477] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.185600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.185667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.185871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.185957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.186180] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.186281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.186346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.186490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.186564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.186753] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.186846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.186938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.188028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.188028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.188028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1140.207840] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.253920] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1140.254194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.254368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.254610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.254804] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.254924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.254989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.255159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.255243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.255339] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.272806] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.273023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.273023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.273232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.273388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.294464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1140.480129] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.480484] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.480643] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.480959] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.481199] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.481888] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.481888] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.481888] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.482133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.482274] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.482615] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.482787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.482910] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.483150] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.483294] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.483444] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f is going to be updated. [ 1140.509870] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.510163] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.510312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.510602] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.510810] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.511062] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.645274] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.710166] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 701311bc-7e63-4b43-8b04-eb0d3bca2b85: rpc.has_security_group_logging(os_id): False [ 1140.728852] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.729063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.729222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.729526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.729675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.729941] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.730071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.730191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.730301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.730383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.730474] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be created. [ 1140.757401] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.800392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.800392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.800392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.800392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.800631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.813210] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: IN_PROGRESS for 2s [ 1141.147643] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.147972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.147972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.148202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.148313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.148415] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1141.188154] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.188337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.188400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.188631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.188787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.195097] env[69238]: INFO networking_nsxv3.common.synchronization [req-4eacfcc4-3305-45fd-ad38-c8b0917ed864 req-34dcf586-6636-464f-a688-3ff67b809cbf tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_members [ 1141.195719] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGHEST for action security_group_members [ 1141.196032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.196288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.196363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.198650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.198650] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.198650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.198650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.198650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.198650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.198650] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.202704] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1141.259152] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.443849] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.444106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.444106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.444284] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.444428] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.503062] env[69238]: INFO networking_nsxv3.common.synchronization [req-d07d3dbe-348b-4c36-9d99-d79fc45384e5 req-7805d5f8-c78e-460a-b08b-5330290fe4be service nova] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_rules [ 1141.503322] env[69238]: INFO networking_nsxv3.common.synchronization [req-d07d3dbe-348b-4c36-9d99-d79fc45384e5 req-7805d5f8-c78e-460a-b08b-5330290fe4be service nova] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 1141.503475] env[69238]: INFO networking_nsxv3.common.synchronization [req-d07d3dbe-348b-4c36-9d99-d79fc45384e5 req-7805d5f8-c78e-460a-b08b-5330290fe4be service nova] Enqueued Resource ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f with Priority: HIGHEST for action port [ 1141.505798] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_rules [ 1141.505948] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 1141.506063] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f with Priority: HIGHEST for action port [ 1141.506355] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.506482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.506548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.506753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.506833] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.507683] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.507798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.507924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.508043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.508216] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.508319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.508382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.508756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.508756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.508756] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.512964] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.513110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.513182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.513352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.513431] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d97e4cea-5fb2-44c5-8349-e2aad8a3381f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.701691] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.701872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.701929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.702184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.725429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.725718] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.725881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.725938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.726110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.726192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.726281] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f is going to be updated. [ 1141.752399] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.752657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.752744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.752962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.753123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.761195] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.761409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.761487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.762150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.762150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.762150] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1141.763688] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f in Status: IN_PROGRESS for 2s [ 1141.789581] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1141.789756] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c deletion is rescheduled due to dependency. [ 1141.789912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.792084] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.792276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.792363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.792636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.792835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.801641] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1141.948086] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.013281] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.014820] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.014961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.016335] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d97e4cea-5fb2-44c5-8349-e2aad8a3381f with status ACTIVE [ 1142.016501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.016616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.016681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.016879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.017020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.017161] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.017260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.017406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.017459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.018069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.018069] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.018069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.018069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.018069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.018069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.018405] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d97e4cea-5fb2-44c5-8349-e2aad8a3381f is going to be updated. [ 1142.040025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.040025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.040025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.040025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.040025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.040290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d97e4cea-5fb2-44c5-8349-e2aad8a3381f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.313848] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1142.314195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.314305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.314523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.314617] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.450617] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.515275] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.818147] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.818395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.828091] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1142.828325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.952716] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1142.952878] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1143.018495] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.018495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.018495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.018495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.018495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.018495] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be updated. [ 1143.053582] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.053816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.053884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.054255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.054489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.068466] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 1143.216786] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1143.217046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.217245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.217490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.217672] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.217789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.217857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.218688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.218874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.218874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.218990] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.724185] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.724185] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.724185] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.724185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.724185] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.725523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.725706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.725935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.726111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.726480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.726676] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.777258] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f in Status: SUCCESS [ 1143.777485] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f deletion is rescheduled due to dependency. [ 1143.777668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.778964] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.779102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.779189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.779462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.797354] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1143.798329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.799681] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1143.811320] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.813783] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.813783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.813783] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.837267] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.837267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.837695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.838055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.853154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.853893] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1143.853970] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1143.854068] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1143.910165] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.910690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.910807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.911032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.912738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.912934] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1143.987421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.988277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.988277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.988277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.988277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.988671] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1144.068852] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.069040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.069081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.069353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.069563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.069837] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1144.069931] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'701311bc-7e63-4b43-8b04-eb0d3bca2b85', 'd3f87108-657a-479d-b25c-126bec380d7f', 'ab3efdeb-971c-4ab9-84e2-455d55746f84', 'eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6', '8b44d3fc-7a43-4b31-850f-15e701b8ab7c', 'adcaa282-9bd0-4318-8903-fc1e657e143d', '66936bcb-aef7-4123-ae9d-1753abcc41e7', '161eb351-451d-49f3-803f-374b4ae2741c', '8bd7bcc4-c543-4591-9293-2c04b0aaef21', '17abedf8-39e0-48a5-82ba-2806c6053ebe', '0c338f61-f5a9-448d-a2fc-f2e38883909f', 'd2cd8869-5f9f-4177-a677-855677a36a05', '1ab364ad-4952-4848-9774-a09b5ae9ee0e', '30b42b8e-961a-4b49-a6b3-231d9a561dc5', 'e23d3814-f79b-4992-979c-27687860c2ee', '4dc6e178-f07a-4c39-b3a2-b770f43610e3', 'c767742c-a318-4de7-875d-b9006231b601', '18ed08a2-cdfd-4978-a1e0-e54baa6accdf', '3b44601a-ed8b-4adb-9b57-205d438615d6', 'e0a6d09e-93ad-4f0a-b077-df666e70f18f', '8fc812c2-d9bf-4340-ac39-bbb8659329cc', 'd15632cf-7f81-4a48-a43d-b6ab97d126e9', '9289966e-1f55-477f-8d5c-d3d5fe95527c', 'd4f8c658-0121-4451-aadb-f2f4c356e1b7', 'e6984856-6c1b-4d02-a5b7-08f98ac851be', 'af5e1a5e-9272-4c94-94cf-f661ba1cc217', '78f92256-b4da-4815-aefb-cda5bc01bc11', '1e00b7de-bd62-4244-a65e-9ce263afed97', 'e3efc2ce-5009-447c-a310-4d3178a7395c', '69fbfff4-4d12-49da-9085-7d562819c005', 'aee600fe-2d5e-4376-8f72-81cf57665aed', '152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6', 'fc8f1ded-72b4-4b3d-86f9-3cc1338a788e', '9a29c175-5acc-4d5c-b7f6-b89ab43280ee', '4b1eab02-6277-4c21-b07d-5b4f5b13a3f2', 'c9df4a22-2e58-46f6-9dc8-bffb28401a54', 'b90b4f01-4981-48aa-a11f-0269ff567c26', 'f19e634f-6fff-469e-93a7-10ba29d4b8a8', 'b6b0ebb8-e601-44fa-aac4-0c8f25377737', 'ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd', '1190c58c-c48e-453c-afe1-9063beda849a', 'c10bb76f-7801-4c7d-b6c4-3f418c87d789', '1cd8a4c5-7d49-440a-bef6-697272c0d01d', 'aa4bf1f1-444a-46b5-b4a0-baa2f52159cc', '5d9b6b76-7856-4e7e-a2a3-3e1756e445ad', '7fc20ddc-91f2-4ada-b5e2-712c907ad8c6', 'fa7aa785-c4cc-4dae-b206-8934232efdf2', 'a6bd121c-8d73-451b-96a4-3bfa5fbaad57', '9501cdef-a5a1-4d58-9c4f-32f41304e816', 'ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe'} {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1144.070031] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1144.091509] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.091675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.091717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.091915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.092010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.092262] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1144.092336] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1144.092407] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1144.179189] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.179189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.179189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.179189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.179189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.181211] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1144.181326] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1144.181408] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1144.181476] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1144.181560] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1144.181630] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGH for action security_group_rules [ 1144.181705] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGH for action security_group_rules [ 1144.181769] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGH for action security_group_rules [ 1144.181828] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGH for action security_group_rules [ 1144.181886] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGH for action security_group_rules [ 1144.181945] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGH for action security_group_rules [ 1144.182026] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGH for action security_group_rules [ 1144.182083] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGH for action security_group_rules [ 1144.182142] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGH for action security_group_rules [ 1144.182464] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGH for action security_group_rules [ 1144.182547] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGH for action security_group_rules [ 1144.182609] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGH for action security_group_rules [ 1144.182683] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGH for action security_group_rules [ 1144.182727] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGH for action security_group_rules [ 1144.182787] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGH for action security_group_rules [ 1144.182845] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGH for action security_group_rules [ 1144.182903] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGH for action security_group_rules [ 1144.182963] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGH for action security_group_rules [ 1144.183033] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGH for action security_group_rules [ 1144.183100] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGH for action security_group_rules [ 1144.183211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.232957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe: rpc.has_security_group_logging(os_id): False [ 1144.253012] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.253190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.253278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.253519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.274923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.277331] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.277552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.277631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.277897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.278317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.278611] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.278741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.278824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.279010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.279120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.279365] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.279489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.279572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.279719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.279795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.279884] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1144.316305] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.316521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.316621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.316872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.317060] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.317161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.317228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.317373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.317458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.317542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.317682] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.317771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.317831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.317964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.318112] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.318203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.318263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.318395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.318470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.318551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.318649] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.346246] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.346436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.346475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.346661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.346798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.362460] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1144.820878] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1144.842851] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.843061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.843115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.843314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.867263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.867579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.867728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.867820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.867996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.868127] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.868354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.868487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.868572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.868747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.868982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.869050] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.869155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.869218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.869365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.869451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.869532] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1144.939730] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.939876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.939961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.940291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.940449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.962473] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1145.080433] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 1145.080652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.082200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.082434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.082639] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.082759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.082830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.082979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.083168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.083168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.083251] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.585407] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.587131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.587390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.587693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.588133] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.588289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.588406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.588600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.588731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.588847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.589079] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.589244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.589361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.589552] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.589728] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.589851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.589920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.590230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.590346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.590489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.590804] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.095457] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78f92256-b4da-4815-aefb-cda5bc01bc11: rpc.has_security_group_logging(os_id): False [ 1146.120958] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.121167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.121553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.121553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.144043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.144043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.144043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.144043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.144559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.144794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.144970] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be updated. [ 1146.304491] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.304690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.304781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.305338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.305338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.332352] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 1146.387956] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1146.388249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.508720] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1146.508827] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1146.508972] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGH for action security_group_rules [ 1146.509276] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 with Priority: HIGH for action security_group_rules [ 1146.509276] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGH for action security_group_rules [ 1146.509384] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23d3814-f79b-4992-979c-27687860c2ee with Priority: HIGH for action security_group_rules [ 1146.509431] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f with Priority: HIGH for action security_group_rules [ 1146.509497] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 with Priority: HIGH for action security_group_rules [ 1146.509586] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf with Priority: HIGH for action security_group_rules [ 1146.509673] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGH for action security_group_rules [ 1146.509760] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGH for action security_group_rules [ 1146.509846] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 with Priority: HIGH for action security_group_rules [ 1146.509928] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGH for action security_group_rules [ 1146.510029] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGH for action security_group_rules [ 1146.510142] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f with Priority: HIGH for action security_group_rules [ 1146.510237] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe with Priority: HIGH for action security_group_rules [ 1146.510338] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 with Priority: HIGH for action security_group_rules [ 1146.510436] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGH for action security_group_rules [ 1146.510522] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGH for action security_group_rules [ 1146.510606] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c with Priority: HIGH for action security_group_rules [ 1146.510689] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGH for action security_group_rules [ 1146.511021] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 with Priority: HIGH for action security_group_rules [ 1146.511133] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.511288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.511356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.515017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.515017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.515017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab3efdeb-971c-4ab9-84e2-455d55746f84 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.515017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.515017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.515017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.515017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab3efdeb-971c-4ab9-84e2-455d55746f84',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.516604] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.516967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.516967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.517191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.517335] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.518542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23d3814-f79b-4992-979c-27687860c2ee taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.518729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.518859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.519276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.519276] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23d3814-f79b-4992-979c-27687860c2ee',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.524030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.524030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.524030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.524030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.524030] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0a6d09e-93ad-4f0a-b077-df666e70f18f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.524030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b44601a-ed8b-4adb-9b57-205d438615d6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.524030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.524030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.524030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.524030] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b44601a-ed8b-4adb-9b57-205d438615d6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.524743] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.524743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.524743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.525095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.525270] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ed08a2-cdfd-4978-a1e0-e54baa6accdf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.526361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.526554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.526642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.526928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.527126] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.528400] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.529117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.529117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.529117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.529440] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.531045] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.531045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.531045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.531045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.531260] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dc6e178-f07a-4c39-b3a2-b770f43610e3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.532569] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.532569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.532740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.532874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.533244] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.534217] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.534394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.534512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.534831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.534957] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.535910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c338f61-f5a9-448d-a2fc-f2e38883909f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.536093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.536235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.536476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.536852] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c338f61-f5a9-448d-a2fc-f2e38883909f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.537637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17abedf8-39e0-48a5-82ba-2806c6053ebe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.537791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.537924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.538183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.538332] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17abedf8-39e0-48a5-82ba-2806c6053ebe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.539301] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.539498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.539862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.539862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.539956] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bd7bcc4-c543-4591-9293-2c04b0aaef21',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.541226] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.541337] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.541672] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.541841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.541950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.542222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.542368] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.544394] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.544394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.544394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.544394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.544394] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b44d3fc-7a43-4b31-850f-15e701b8ab7c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.546141] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.546298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.546714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.546714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.549075] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.549075] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.549075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.549075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.549075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.549075] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.577892] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.578162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.578241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.578483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.580319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.580432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.601641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.601641] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ed08a2-cdfd-4978-a1e0-e54baa6accdf is going to be deleted. [ 1146.603196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.603704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.622325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.622504] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23d3814-f79b-4992-979c-27687860c2ee is going to be deleted. [ 1146.663113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.663113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.663113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.663113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.663306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.663306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ed08a2-cdfd-4978-a1e0-e54baa6accdf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.673315] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.673455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.673525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.673730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.673965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.673965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23d3814-f79b-4992-979c-27687860c2ee" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.984430] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1146.984746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.985141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.985276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.985411] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.037475] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.038120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.038120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.038294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.056344] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.056626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.056727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.056967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.057310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.057310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.057441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.057505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.057578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.057658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.057746] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.059181] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.059316] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.059383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.059549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.059829] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.059829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.059971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.060123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.060266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.060335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.060362] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.065728] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.065728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.065728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.065728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.065948] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.065948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.066093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.066320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.066320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.066404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.066451] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.069310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.069310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.069310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.069310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.069310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.069310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.069310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.069584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.069584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.069641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.069809] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.074018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.074694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.074791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.074952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.075265] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.075363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.075424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.075578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.075675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.075759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.075841] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.082725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.082725] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab3efdeb-971c-4ab9-84e2-455d55746f84 is going to be deleted. [ 1147.084276] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.084419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.084508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.084740] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.084915] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.085030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.085100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.085285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.085407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.085513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.085609] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.155453] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.155769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.155769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.155996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.158464] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.158598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.173930] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.174339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.175268] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.175402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.176592] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.176733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.177574] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.177685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.182158] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.182158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.182158] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.182158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.182932] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.182932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.185571] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.185745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.188197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.188355] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be deleted. [ 1147.189366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.189606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.237931] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.237931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.240886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.240886] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be deleted. [ 1147.241933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.242136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.274528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.274778] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dc6e178-f07a-4c39-b3a2-b770f43610e3 is going to be deleted. [ 1147.275890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.276130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.283871] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.284080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.316843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.317025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b44601a-ed8b-4adb-9b57-205d438615d6 is going to be deleted. [ 1147.318188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.318502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.327505] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.327749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.385572] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.385768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.386850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.387035] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17abedf8-39e0-48a5-82ba-2806c6053ebe is going to be deleted. [ 1147.388335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.388669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.449645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.449801] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b44d3fc-7a43-4b31-850f-15e701b8ab7c is going to be deleted. [ 1147.451364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.451743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.472586] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.472871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.488440] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.488661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.488739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.488992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.489303] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.489447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.489499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.489701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.489845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.489992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.490236] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.493986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.494938] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bd7bcc4-c543-4591-9293-2c04b0aaef21 is going to be deleted. [ 1147.496121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.496431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.509893] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.510056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.570027] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.571567] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.578528] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.579431] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.584096] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.586418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.586557] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0a6d09e-93ad-4f0a-b077-df666e70f18f is going to be deleted. [ 1147.587592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.587821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.605587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.605692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.608503] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.608671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.608671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.608892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.609093] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.609197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.609260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.609512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.609551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.609640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.609803] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.609918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.609952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.610124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.610266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.610357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.610418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.610555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.610633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.610714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.610809] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.631105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.631172] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6 is going to be deleted. [ 1147.632458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.632458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.669738] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.669738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.671915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.672082] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c338f61-f5a9-448d-a2fc-f2e38883909f is going to be deleted. [ 1147.673305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.673549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.673670] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.673877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab3efdeb-971c-4ab9-84e2-455d55746f84" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.674144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.674422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.674525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.674662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.675520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.675804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.675924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.676111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.676297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.676701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.676701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.676804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dc6e178-f07a-4c39-b3a2-b770f43610e3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.676987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.677187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.677293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.677438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b44601a-ed8b-4adb-9b57-205d438615d6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.677601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.677857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.678033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.678190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17abedf8-39e0-48a5-82ba-2806c6053ebe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.678354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.678532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.678634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.678776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b44d3fc-7a43-4b31-850f-15e701b8ab7c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.678943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.679306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.679428] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.679574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bd7bcc4-c543-4591-9293-2c04b0aaef21" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.754645] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.754913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.754975] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.755237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.755458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.755458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0a6d09e-93ad-4f0a-b077-df666e70f18f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.798834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.798834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.798834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.799129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.799129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.799355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb621de2-b144-4ec1-ae4d-0ff67dfb6bf6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.806418] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1147.807224] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.807568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.808042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.808042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.808204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.808399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c338f61-f5a9-448d-a2fc-f2e38883909f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.993632] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.993884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.993884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.994317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.994317] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.994505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.994505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.994596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.994678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.994763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.994907] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.994997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.995069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.995206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.995340] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.995428] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.995483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.995619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.995687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.995760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.995846] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.071970] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c767742c-a318-4de7-875d-b9006231b601: rpc.has_security_group_logging(os_id): False [ 1148.073917] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f87108-657a-479d-b25c-126bec380d7f: rpc.has_security_group_logging(os_id): False [ 1148.082754] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2cd8869-5f9f-4177-a677-855677a36a05: rpc.has_security_group_logging(os_id): False [ 1148.083942] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66936bcb-aef7-4123-ae9d-1753abcc41e7: rpc.has_security_group_logging(os_id): False [ 1148.089634] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 701311bc-7e63-4b43-8b04-eb0d3bca2b85: rpc.has_security_group_logging(os_id): False [ 1148.096553] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.096808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.096808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.096968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.099280] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.099435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.105152] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.105370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.109767] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.109937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.110876] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.111122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.116688] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab364ad-4952-4848-9774-a09b5ae9ee0e: rpc.has_security_group_logging(os_id): False [ 1148.118830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.119149] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.119274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.119328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.119681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.119786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.119879] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be updated. [ 1148.121084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.121315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.140177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.140314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.146889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.147304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.147430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.147489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.147712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.147895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.147955] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c767742c-a318-4de7-875d-b9006231b601 is going to be updated. [ 1148.149249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.149462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.180536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.180536] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.180536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.180536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.180536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.180871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.180871] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 is going to be updated. [ 1148.183039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.183039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.204190] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.204515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.224386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.224863] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.225058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.225174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.225446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.225563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.226284] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1148.228208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.228558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.270313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.270795] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.270866] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.270931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.271164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.271255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.271356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be updated. [ 1148.274462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.275827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.275827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.277298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.277532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.299053] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.299711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.300945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.301111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.314931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.315207] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.316568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.316648] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.316930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.317132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.317430] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.320250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.320537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.321300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.321300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.321682] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.321838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.322108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.322251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.324591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.324591] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be updated. [ 1148.324591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.324591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.324591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.325846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.325846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.325846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.328308] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 1148.372360] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.372360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.372566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.372614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.372778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.376614] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: IN_PROGRESS for 2s [ 1148.380249] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: IN_PROGRESS for 2s [ 1148.392111] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 1148.392347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.399402] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.399560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.399638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.399830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.400915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.425107] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1148.438609] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: IN_PROGRESS for 2s [ 1148.498874] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1148.538177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.538447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.538517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.538714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.538872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.541035] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.541231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.541315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.541622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.541622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.541859] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.541960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.542083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.542216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.542363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.542563] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.542657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.542729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.542855] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.542937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.543161] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.543315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.543315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.543469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.543568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.543568] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1148.572555] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 1148.637844] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.638156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.638258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.638524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.638700] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.678318] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1149.228296] env[69238]: INFO networking_nsxv3.common.synchronization [req-4cf88d51-ba29-4516-9bac-795e6dee6872 req-f990fdd7-46d1-40f7-a8d3-0050b25ffca4 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1149.228901] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1149.229264] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.229424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.229461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.229663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.229821] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.229920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.229980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.230832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.230932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.231048] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.738135] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.738135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.738135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.738135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.761297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.761297] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.761504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.761504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.761587] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.761647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.761733] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1149.790584] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.790769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.790810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.791028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.791384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.804178] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1150.341798] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 1150.342095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.392116] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: SUCCESS [ 1150.392377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.393162] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: SUCCESS [ 1150.393333] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.439295] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1150.439518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.451399] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1150.451637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.592051] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 1150.592051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.697962] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1150.699027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.815085] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1151.815497] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 1151.815497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.229836] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1154.230213] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1155.218746] env[69238]: INFO networking_nsxv3.common.synchronization [req-35f38fce-044b-487c-bbe5-805c13b65509 req-2df0bf1d-ae60-45d9-a5db-adf9e384d3c2 tempest-ServersTestManualDisk-1014510655 tempest-ServersTestManualDisk-1014510655-project-member] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_members [ 1155.219273] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGHEST for action security_group_members [ 1155.219587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.219707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.219769] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.219983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.220161] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.220260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.220318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.220464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.220546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.222383] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.315520] env[69238]: INFO networking_nsxv3.common.synchronization [req-6b84b266-66c3-4483-8e60-6ba63676a4fe req-1c26e91b-e0e4-414d-a28a-7ddd202f7593 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1155.315520] env[69238]: INFO networking_nsxv3.common.synchronization [req-6b84b266-66c3-4483-8e60-6ba63676a4fe req-1c26e91b-e0e4-414d-a28a-7ddd202f7593 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1155.315520] env[69238]: INFO networking_nsxv3.common.synchronization [req-6b84b266-66c3-4483-8e60-6ba63676a4fe req-1c26e91b-e0e4-414d-a28a-7ddd202f7593 tempest-SecurityGroupsTestJSON-1615514252 tempest-SecurityGroupsTestJSON-1615514252-project-member] Enqueued Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_members [ 1155.315876] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe with Priority: HIGHEST for action security_group_members [ 1155.315876] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGHEST for action security_group_members [ 1155.315876] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 with Priority: HIGHEST for action security_group_members [ 1155.316123] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.316187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.316247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.316687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.316687] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.316687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.316906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.316906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.316906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.317050] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.317825] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.320968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.320968] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.320968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.320968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.320968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.320968] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc20ddc-91f2-4ada-b5e2-712c907ad8c6',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.462277] env[69238]: INFO networking_nsxv3.common.synchronization [req-95ef4c9c-a9cb-4391-b59d-3797eae407c7 req-1ef12d92-4ad3-4aa1-bc57-72c13fc51c88 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1155.462277] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1155.462277] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.462277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.462277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.462277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.462277] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.462277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.462277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.463570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.463760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.463989] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.729023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.729023] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.729023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.729023] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 is going to be updated. [ 1155.762165] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.762394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.762394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.762711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.762766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.775971] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: IN_PROGRESS for 2s [ 1155.822868] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.823170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.823298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.823670] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.823849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.824185] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.824360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.824448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.824709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.824858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.824985] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe is going to be updated. [ 1155.826775] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.826971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.827095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.827381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.829136] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.829210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.852285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.852603] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.852755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.852834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.853075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.853209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.853320] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be updated. [ 1155.855614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.855614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.879027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.879027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.879027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.879027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.879027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.882266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.882693] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.882949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.883143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.883425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.883637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.883887] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 is going to be updated. [ 1155.891750] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: IN_PROGRESS for 2s [ 1155.894160] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.894479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.895523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.895523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.895523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.904064] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: IN_PROGRESS for 2s [ 1155.922902] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.922902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.922902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.922902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.922902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.934350] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: IN_PROGRESS for 2s [ 1155.968301] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.356063] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.356431] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.356526] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.356818] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.357104] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.357271] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.357391] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.357608] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.357759] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.357973] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.358107] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.358225] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.358335] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.358447] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.358556] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.358688] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.381030] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.381296] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.381484] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.381700] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.382275] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.382275] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.382471] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.382761] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.382933] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.473740] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.643047] env[69238]: INFO networking_nsxv3.common.synchronization [None req-31c430a6-f14e-4738-b58c-ebe9866823c0 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_rules [ 1156.643047] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_rules [ 1156.643047] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a436812-7ebf-4b10-8e25-2625390204e8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.643047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.643047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.643749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.644027] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.732556] env[69238]: INFO networking_nsxv3.common.synchronization [None req-8f37be88-48f3-4ba9-a7f1-c689aa08d259 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_rules [ 1156.733117] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_rules [ 1156.733431] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a436812-7ebf-4b10-8e25-2625390204e8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.733768] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.886086] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.886376] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.886550] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.886939] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.887148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.887473] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab not found, creating... [ 1156.887879] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.888157] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.888487] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.889100] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.889100] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.889337] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.889553] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.889703] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.890096] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.890258] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.890442] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab is going to be created. [ 1156.913751] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.913994] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.914171] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.914501] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.915037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.915037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.975929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.976214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.976326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.976597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.976719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.976870] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be updated. [ 1157.006959] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.007132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.007524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.007524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.007683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.026342] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: IN_PROGRESS for 2s [ 1157.168638] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.168880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.168880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.169090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.169162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.169258] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a436812-7ebf-4b10-8e25-2625390204e8 already deleted. [ 1157.169341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.169527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.169638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.169719] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.611308] env[69238]: INFO networking_nsxv3.common.synchronization [req-ccbbc267-4b34-4132-82f0-6734a510cda5 req-e9716e1a-ce8a-4e9f-8710-72e18ad96095 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1157.611787] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1157.615032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.615032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.615032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.615032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.615032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.615032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.615032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.615032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.615032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.615032] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.691222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.691448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.691527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.691757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.691849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.691951] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a436812-7ebf-4b10-8e25-2625390204e8 already deleted. [ 1157.692045] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.787581] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2cd8869-5f9f-4177-a677-855677a36a05 in Status: SUCCESS [ 1157.787581] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 deletion is rescheduled due to dependency. [ 1157.787581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.860184] env[69238]: INFO networking_nsxv3.common.synchronization [req-95ef4c9c-a9cb-4391-b59d-3797eae407c7 req-fcd31589-d55c-42a8-862e-3e2808bfb5cb service nova] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1157.860497] env[69238]: INFO networking_nsxv3.common.synchronization [req-95ef4c9c-a9cb-4391-b59d-3797eae407c7 req-fcd31589-d55c-42a8-862e-3e2808bfb5cb service nova] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1157.860834] env[69238]: INFO networking_nsxv3.common.synchronization [req-95ef4c9c-a9cb-4391-b59d-3797eae407c7 req-fcd31589-d55c-42a8-862e-3e2808bfb5cb service nova] Enqueued Resource ID: ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab with Priority: HIGHEST for action port [ 1157.861694] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_rules [ 1157.861910] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1157.863850] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab with Priority: HIGHEST for action port [ 1157.863850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.863850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.863850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.863850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.863850] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.864636] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.864636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.864758] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.864844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.864951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.865172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.865266] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.907678] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe in Status: SUCCESS [ 1157.907678] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe deletion is rescheduled due to dependency. [ 1157.907678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.915279] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc in Status: SUCCESS [ 1157.915479] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc deletion is rescheduled due to dependency. [ 1157.915596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.949597] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 in Status: SUCCESS [ 1157.949872] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc20ddc-91f2-4ada-b5e2-712c907ad8c6 deletion is rescheduled due to dependency. [ 1157.950107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc20ddc-91f2-4ada-b5e2-712c907ad8c6" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.002739] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.002938] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.003080] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.003362] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.003622] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.003784] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.003904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.004137] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.004296] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.004511] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.004629] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.004741] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.004851] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.004961] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.005088] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.005226] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.039134] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.039397] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.039487] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.039673] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.040016] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.040279] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.040410] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.040743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.040885] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e42f5f4-9121-4961-9a82-b92f0b1bf38e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.117025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.117025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.117025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.117025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.117025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.117025] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.117025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.117025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.117446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.117446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.117664] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be deleted. [ 1158.153017] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.153180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.153257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.153440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.153529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.153835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.367360] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.367517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.367721] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab with status ACTIVE [ 1158.367914] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.368046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.368125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.368357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.368494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.368669] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.368756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.368835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.369441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.369441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.369441] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.369441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.369441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.369720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.369720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.369784] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab is going to be updated. [ 1158.394539] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.394716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.394765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.394946] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.395115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.395260] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebf2d3b4-dfd1-4ee8-97e5-2dfd9e840fab" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.543568] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.544007] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.544281] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.544754] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.545062] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.545373] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 6e42f5f4-9121-4961-9a82-b92f0b1bf38e not found, creating... [ 1158.545871] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.546195] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.546452] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.546845] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.547117] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.547632] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.547975] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.548183] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.548582] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.548857] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.549161] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 6e42f5f4-9121-4961-9a82-b92f0b1bf38e is going to be created. [ 1158.573721] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.573721] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.573721] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.573948] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.574195] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.574428] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.035975] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1159.036393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.036507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.036724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.036920] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.037069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.037132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.037315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.037403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.037497] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.105475] env[69238]: INFO networking_nsxv3.common.synchronization [req-eba61f94-a317-4617-9be9-94448b30a110 req-dae108b6-6aa2-45d7-9b1b-c23d09f904f4 tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 1159.106086] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 1159.106391] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.106538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.106595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.106819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.106968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.108080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.108177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.108349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.108440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.108535] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.271394] env[69238]: INFO networking_nsxv3.common.synchronization [req-ccbbc267-4b34-4132-82f0-6734a510cda5 req-f06919a4-b5d6-4bae-b279-cc0254e58702 service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1159.271546] env[69238]: INFO networking_nsxv3.common.synchronization [req-ccbbc267-4b34-4132-82f0-6734a510cda5 req-f06919a4-b5d6-4bae-b279-cc0254e58702 service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1159.271695] env[69238]: INFO networking_nsxv3.common.synchronization [req-ccbbc267-4b34-4132-82f0-6734a510cda5 req-f06919a4-b5d6-4bae-b279-cc0254e58702 service nova] Enqueued Resource ID: 6e42f5f4-9121-4961-9a82-b92f0b1bf38e with Priority: HIGHEST for action port [ 1159.271939] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1159.272109] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1159.272240] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e42f5f4-9121-4961-9a82-b92f0b1bf38e with Priority: HIGHEST for action port [ 1159.273375] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.273551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.273624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.273833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.273921] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.274796] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.274911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.275009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.279020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.279020] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.279020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.279020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.279020] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e42f5f4-9121-4961-9a82-b92f0b1bf38e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.540700] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.612841] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.783298] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.784055] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.784198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.784762] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e42f5f4-9121-4961-9a82-b92f0b1bf38e with status ACTIVE [ 1159.785147] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.785305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.785463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.785755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.785907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.786250] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.786344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.786436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.786724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.786795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.787065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.787242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.787496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.787582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.787743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.788817] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e42f5f4-9121-4961-9a82-b92f0b1bf38e is going to be updated. [ 1159.811713] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.812530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.812530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.812667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.812908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.813148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e42f5f4-9121-4961-9a82-b92f0b1bf38e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.044732] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.079296] env[69238]: INFO networking_nsxv3.common.synchronization [req-19677e3a-85ae-40e0-9c24-04e4d72003a5 req-a98d4a56-3a3f-4b63-9519-7bc8c5fd3bc8 tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1160.079797] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1160.080172] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.080623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.080694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.081175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.081175] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.081175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.081319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.081389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.081472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.081562] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.114945] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.285017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.363098] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.363379] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.363435] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.363703] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.363956] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.364787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.364863] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.365080] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.365234] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.365500] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.365557] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.365661] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.365769] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.365880] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.365988] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.367028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.385191] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.385363] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1160.385501] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.385687] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-734" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.385997] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-38376a44-387b-4157-8739-05dccb95e840 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.386176] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.386296] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.386620] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.386756] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38376a44-387b-4157-8739-05dccb95e840',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.545868] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.546162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.546262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.546524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.546662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.546814] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be updated. [ 1160.580486] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.580486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.580486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.580486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.580486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.583423] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.583561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.583615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.583815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.583904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.584112] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.584217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.584276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.584428] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.584504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.584589] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1160.591426] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: IN_PROGRESS for 2s [ 1160.610172] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.610416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.610416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.610612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.611251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.617933] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.618190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.618249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.618519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.618649] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.618772] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be updated. [ 1160.620792] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1160.647731] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.648168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.648338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.648586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.648766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.659792] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 1160.792961] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.792961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.792961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.792961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.792961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.792961] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be created. [ 1160.818427] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.818672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.818746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.819006] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.819186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.833465] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: UNINITIALIZED for 2s [ 1160.888932] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.889189] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.889317] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.889613] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.889774] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.889936] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 38376a44-387b-4157-8739-05dccb95e840 not found, creating... [ 1160.890264] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.890437] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.890562] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.890790] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.890938] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.891292] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.891692] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.891692] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.891856] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.891856] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.892068] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 38376a44-387b-4157-8739-05dccb95e840 is going to be created. [ 1160.921198] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.921198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.921198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.921198] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.921471] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.921548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.628793] env[69238]: INFO networking_nsxv3.common.synchronization [req-19677e3a-85ae-40e0-9c24-04e4d72003a5 req-e3ac7c95-e664-443d-94e9-39e61065bc93 service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 1161.629033] env[69238]: INFO networking_nsxv3.common.synchronization [req-19677e3a-85ae-40e0-9c24-04e4d72003a5 req-e3ac7c95-e664-443d-94e9-39e61065bc93 service nova] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1161.629144] env[69238]: INFO networking_nsxv3.common.synchronization [req-19677e3a-85ae-40e0-9c24-04e4d72003a5 req-e3ac7c95-e664-443d-94e9-39e61065bc93 service nova] Enqueued Resource ID: 38376a44-387b-4157-8739-05dccb95e840 with Priority: HIGHEST for action port [ 1161.629368] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_rules [ 1161.629519] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1161.629582] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38376a44-387b-4157-8739-05dccb95e840 with Priority: HIGHEST for action port [ 1161.632977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.633141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.633213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.633416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.633569] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.636888] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.636888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.636888] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-38376a44-387b-4157-8739-05dccb95e840 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.636888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.636888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.636888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.636888] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38376a44-387b-4157-8739-05dccb95e840',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.137299] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.137299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.141409] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38376a44-387b-4157-8739-05dccb95e840 with status ACTIVE [ 1162.141709] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.141850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.141946] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.142324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.142476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.142718] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.142854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.142923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.143131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.143228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.143487] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.143592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.143652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.143813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.143888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.143973] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38376a44-387b-4157-8739-05dccb95e840 is going to be updated. [ 1162.168705] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.168879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.168978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.169240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.169395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.169575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38376a44-387b-4157-8739-05dccb95e840" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.601310] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1162.601540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.601715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.601948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.602166] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.602294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.602383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.602559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.602752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.602841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.602889] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.631706] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1162.631993] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 1162.632162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.632825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.633071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.633380] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.633537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.633610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.633793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.633914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.634060] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.671737] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 1162.672161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.846560] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1162.846996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.847345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.847703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.847978] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.848188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.848295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.848485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.848589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.848702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.848839] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.105452] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.137647] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.353092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.353092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.353092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.353393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.353621] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.353770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.353864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.354145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.354367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.354436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.354667] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.354817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.354925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.355177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.355408] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.355537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.355618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.355788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.355880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.355979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.356097] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.607880] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 701311bc-7e63-4b43-8b04-eb0d3bca2b85: rpc.has_security_group_logging(os_id): False [ 1163.628801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.629033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.629086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.629350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.629487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.629781] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.629927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.630100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.630172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.630267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.630353] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be updated. [ 1163.638831] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.699074] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.699074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.699074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.699074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.699074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.713994] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: IN_PROGRESS for 2s [ 1163.859589] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b42b8e-961a-4b49-a6b3-231d9a561dc5: rpc.has_security_group_logging(os_id): False [ 1163.881042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.881042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.881042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.881042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.884630] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.884942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.885112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.885369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.885539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.885697] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be created. [ 1163.953967] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.954133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.954217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.954420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.954607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.977464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1164.141863] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.142073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.142149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.143946] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.144104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.144252] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1164.183082] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.183343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.183458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.183761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.183994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.198763] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1165.732138] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1165.732530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.777265] env[69238]: INFO networking_nsxv3.common.synchronization [req-6b6ccf30-5ce5-48ea-b182-2b3d8e97aa94 req-b531aaa3-ed5e-413c-ae54-2849071d3ad8 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_members [ 1165.777963] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 with Priority: HIGHEST for action security_group_members [ 1165.778255] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c10bb76f-7801-4c7d-b6c4-3f418c87d789 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.778384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.778445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.778707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.779246] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.779246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.779246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.779246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.779246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.779493] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c10bb76f-7801-4c7d-b6c4-3f418c87d789',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.000779] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1166.000779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.213979] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1166.214237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.214422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.214658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.214878] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.214995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.215059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.215226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.215297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.215423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.215480] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.283596] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.283743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.283811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.284067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.307701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.308013] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.309035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.309035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.309035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.309035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.309035] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 is going to be updated. [ 1166.395914] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.395914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.395914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.395914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.395914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.405293] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 in Status: IN_PROGRESS for 2s [ 1166.719666] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.719666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.719666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.719666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.719666] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.720031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.720031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.720118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.720270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.720425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.720670] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.720829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.720936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.721182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.721410] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.723081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.723081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.723081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.723081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.723081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.723081] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.046194] env[69238]: INFO networking_nsxv3.common.synchronization [None req-88bb96fb-ec2d-4bc1-84a6-ae47b730a823 tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1167.046818] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1167.047079] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.047210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.047278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.047479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.047642] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.047748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.047812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.051018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.051018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.051018] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.228023] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cd8a4c5-7d49-440a-bef6-697272c0d01d: rpc.has_security_group_logging(os_id): False [ 1167.248800] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.249029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.249029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.249234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.249365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.249610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.249770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.249876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.250149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.250741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.250741] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.250741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.250741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.250944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.250944] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.251087] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.251131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.251302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.251339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.251401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.251485] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1167.362219] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.362403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.362492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.362674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.362823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.380688] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1167.550491] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.550665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.550705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.550918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.577952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.577952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.577952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.577952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.577952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.577952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.577952] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1167.603011] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.603156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.603232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.603458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.603594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.615602] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1167.631573] env[69238]: INFO networking_nsxv3.common.synchronization [req-704c68c9-3c21-498a-bea0-2039dd238cb9 req-9f75efbf-7a19-4fa9-84f2-8e00662b66ba tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1167.632224] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1167.632465] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.632581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.633028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.633255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.633423] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.633525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.633584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.633725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.634028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.634028] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.141334] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.305311] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.305311] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.305311] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.305311] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.305311] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.305311] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.305311] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.305683] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.306178] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.306178] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.306322] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.306479] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.306628] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.306814] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.306928] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.307124] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.333756] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.333756] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1168.333990] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.334110] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.334525] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-07916478-ae0b-48de-9fea-ad35ad7ed2d9 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.334745] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.334911] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.338122] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.338122] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07916478-ae0b-48de-9fea-ad35ad7ed2d9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.416970] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 in Status: SUCCESS [ 1168.417179] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c10bb76f-7801-4c7d-b6c4-3f418c87d789 deletion is rescheduled due to dependency. [ 1168.417325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c10bb76f-7801-4c7d-b6c4-3f418c87d789" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.643734] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.841211] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.841515] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.841682] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.842030] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.842273] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.842435] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 07916478-ae0b-48de-9fea-ad35ad7ed2d9 not found, creating... [ 1168.842787] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.843096] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.843363] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.843503] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.843727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.844324] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.844539] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.844697] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.845029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.845261] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.845453] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 07916478-ae0b-48de-9fea-ad35ad7ed2d9 is going to be created. [ 1168.874919] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.875141] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.875280] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.875611] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.875806] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.876230] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.146716] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.147157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.147157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.147264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.147312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.147426] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1169.185610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.185811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.185856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.186091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.186268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.197436] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1169.399120] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1169.399120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.591652] env[69238]: INFO networking_nsxv3.common.synchronization [req-704c68c9-3c21-498a-bea0-2039dd238cb9 req-0982a199-8a72-44dd-8f9b-7f27627fb943 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1169.591868] env[69238]: INFO networking_nsxv3.common.synchronization [req-704c68c9-3c21-498a-bea0-2039dd238cb9 req-0982a199-8a72-44dd-8f9b-7f27627fb943 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1169.592097] env[69238]: INFO networking_nsxv3.common.synchronization [req-704c68c9-3c21-498a-bea0-2039dd238cb9 req-0982a199-8a72-44dd-8f9b-7f27627fb943 service nova] Enqueued Resource ID: 07916478-ae0b-48de-9fea-ad35ad7ed2d9 with Priority: HIGHEST for action port [ 1169.592349] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1169.592499] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1169.593210] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07916478-ae0b-48de-9fea-ad35ad7ed2d9 with Priority: HIGHEST for action port [ 1169.594190] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.596438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.596511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.596738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.596812] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.597691] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.597789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.597967] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-07916478-ae0b-48de-9fea-ad35ad7ed2d9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.598117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.598199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.598309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.598421] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07916478-ae0b-48de-9fea-ad35ad7ed2d9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.627439] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1169.627625] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be deletion is rescheduled due to dependency. [ 1169.627687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.957181] env[69238]: INFO networking_nsxv3.common.synchronization [req-ef32e487-337b-4727-887b-361b2438c8e6 req-01dde583-a60c-47ce-a532-c67b9492f2ab tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1169.957181] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1169.957181] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.958413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.958942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.959437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.959722] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.960110] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.960277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.960510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.960687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.960859] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.103456] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.103456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.103456] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07916478-ae0b-48de-9fea-ad35ad7ed2d9 with status ACTIVE [ 1170.103456] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.103456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.103456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.103456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.104173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.104173] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.104173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.104173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.104173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.104173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.104461] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.104461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.104461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.104461] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.105303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.105303] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07916478-ae0b-48de-9fea-ad35ad7ed2d9 is going to be updated. [ 1170.130328] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.130583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.130703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.130960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.131240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.131463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07916478-ae0b-48de-9fea-ad35ad7ed2d9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.305066] env[69238]: INFO networking_nsxv3.common.synchronization [None req-eacc230f-09ec-4403-826b-34a221313c3f tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_rules [ 1170.306583] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_rules [ 1170.306954] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.307111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.307177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.307431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.307518] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.463506] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.463506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.463673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.463815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.463936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.464223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.464357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.464453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.464664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.464767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.464876] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be deleted. [ 1170.500461] env[69238]: INFO networking_nsxv3.common.synchronization [None req-bbe34595-a345-42c0-9363-b54458a09f5a tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_rules [ 1170.501545] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.501748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.501809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.502069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.502211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.502338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.502828] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_rules [ 1170.503439] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.503538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.631361] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.631557] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.631724] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.632575] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.632923] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.633221] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.633368] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.633667] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.633979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.634810] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.635021] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.636091] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.636091] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.636091] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.636091] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.636280] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.658934] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.659128] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1170.659278] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.659462] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.659828] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.660050] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.660172] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.660524] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.660668] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc43ac23-78b7-4cc4-819e-d6e6a539d30a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.831379] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.831379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.831379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.831379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.831379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.831575] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 already deleted. [ 1170.831575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.831693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.832153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.832310] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.164530] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.165181] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.165457] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.166051] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.166200] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.166383] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port bc43ac23-78b7-4cc4-819e-d6e6a539d30a not found, creating... [ 1171.166778] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.167031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.167323] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.170651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.170651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.170651] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.170651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.170651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.170651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.170651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.170651] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a is going to be created. [ 1171.195584] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.196403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.196604] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.197221] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.197528] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.198012] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.221498] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1171.222853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.223774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.224460] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.225275] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.225522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.225676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.225982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.226400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.226661] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.366633] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.367051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.367051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.367276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.367364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.367464] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 already deleted. [ 1171.367543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.729395] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.113327] env[69238]: INFO networking_nsxv3.common.synchronization [req-ef32e487-337b-4727-887b-361b2438c8e6 req-4ef198d3-a62f-41f6-a91d-f27011d944e8 service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 1172.113327] env[69238]: INFO networking_nsxv3.common.synchronization [req-ef32e487-337b-4727-887b-361b2438c8e6 req-4ef198d3-a62f-41f6-a91d-f27011d944e8 service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1172.113327] env[69238]: INFO networking_nsxv3.common.synchronization [req-ef32e487-337b-4727-887b-361b2438c8e6 req-4ef198d3-a62f-41f6-a91d-f27011d944e8 service nova] Enqueued Resource ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a with Priority: HIGHEST for action port [ 1172.113327] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 1172.113327] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1172.113327] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a with Priority: HIGHEST for action port [ 1172.113868] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.118504] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.118504] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.118504] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.118504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.118504] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.119861] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.119861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.119861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.120979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.120979] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc43ac23-78b7-4cc4-819e-d6e6a539d30a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.232687] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.623109] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc43ac23-78b7-4cc4-819e-d6e6a539d30a with status ACTIVE [ 1172.623516] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.623641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.623709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.623932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.624085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.624255] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.624472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.624472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.624577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.624655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.624835] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.624930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.624997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.625145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.625220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.625327] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a is going to be updated. [ 1172.630341] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.630341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.630341] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.664834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.665117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.665198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.668787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.668787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.668787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.735413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.735588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.735659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.735910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.735997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.738883] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1172.783837] env[69238]: INFO networking_nsxv3.common.synchronization [req-90de1de4-62e5-4c82-bacf-2ecc5bb9afd6 req-3e55d54c-58c3-4200-9f38-2afec1d3ecfc tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_members [ 1172.784521] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_members [ 1172.785061] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a436812-7ebf-4b10-8e25-2625390204e8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.785250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.785340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.785677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.785862] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.785979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.786066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.786795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.786906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.787020] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.822427] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.822427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.822427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.822427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.822427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.857107] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1173.132435] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.290338] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.290525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.290525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.290732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.290822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.291021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.291173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.291262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.291482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.291571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.291661] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a436812-7ebf-4b10-8e25-2625390204e8 already deleted. [ 1173.291741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.394433] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.394645] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.394774] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.395554] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.395884] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.396082] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.396210] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.396461] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.396712] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.396939] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1173.397746] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.397746] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.397746] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.397746] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1173.397746] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.397746] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.417525] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.417715] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1173.417860] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.418114] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.418495] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.418742] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.418951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.419953] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.420138] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.637936] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.637936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.637936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.637936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.637936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.637936] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be created. [ 1173.686488] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.687447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.687530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.687750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.687929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.700666] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: UNINITIALIZED for 2s [ 1173.923820] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.924155] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.924312] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.924650] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.924873] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.925084] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 not found, creating... [ 1173.925433] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.925661] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.925792] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.926077] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.926300] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.926711] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.927143] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.927272] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.927573] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.927756] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.927987] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 is going to be created. [ 1173.950942] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.951155] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.951313] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.951612] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.951852] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.952125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.870096] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.870096] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.870096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.870096] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.135691] env[69238]: INFO networking_nsxv3.common.synchronization [req-90de1de4-62e5-4c82-bacf-2ecc5bb9afd6 req-9f718514-4108-43ce-b9c9-216ca91d1fbc service nova] Enqueued Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_rules [ 1175.135887] env[69238]: INFO networking_nsxv3.common.synchronization [req-90de1de4-62e5-4c82-bacf-2ecc5bb9afd6 req-9f718514-4108-43ce-b9c9-216ca91d1fbc service nova] Enqueued Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_members [ 1175.136042] env[69238]: INFO networking_nsxv3.common.synchronization [req-90de1de4-62e5-4c82-bacf-2ecc5bb9afd6 req-9f718514-4108-43ce-b9c9-216ca91d1fbc service nova] Enqueued Resource ID: d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 with Priority: HIGHEST for action port [ 1175.136281] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_rules [ 1175.136411] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_members [ 1175.136509] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 with Priority: HIGHEST for action port [ 1175.137371] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a436812-7ebf-4b10-8e25-2625390204e8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.137543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.137634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.137898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.138013] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.143135] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a436812-7ebf-4b10-8e25-2625390204e8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.143135] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.143135] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.143135] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.143135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.143135] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.378084] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.378280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.378354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.378570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.378767] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.378970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.378970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.379129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.379539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.381286] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.381286] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.381286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.381286] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.417478] env[69238]: INFO networking_nsxv3.common.synchronization [req-a3d798d6-3759-4a75-b966-e75ec59a2035 req-49a5b6ae-565d-4fc4-839b-b013bfabb31a tempest-ServerDiskConfigTestJSON-1462090014 tempest-ServerDiskConfigTestJSON-1462090014-project-member] Enqueued Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1175.417964] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d with Priority: HIGHEST for action security_group_members [ 1175.418304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd8a4c5-7d49-440a-bef6-697272c0d01d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.418451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.418540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.418770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.418942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.419218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.419294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.419479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.419564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.419681] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd8a4c5-7d49-440a-bef6-697272c0d01d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.643935] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.646302] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a436812-7ebf-4b10-8e25-2625390204e8 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.646532] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.646823] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 with status ACTIVE [ 1175.646989] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.647108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.647175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.647381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.647472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.647868] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.647868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.647868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.648037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.648037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.652254] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.652386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.652493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.652827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.652976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.653131] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3 is going to be updated. [ 1175.678145] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.678145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.678145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.678145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.678145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.678414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3ca2bfe-0d8b-46e7-85de-4fa2ed19ffe3" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.716190] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1175.717023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.717023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.717023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.717212] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.717390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.717529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.717804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.717933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.718046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.718142] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.883045] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1175.903525] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.903525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.903525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.903525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.903525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.903833] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.903833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.903833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.903935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.903935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.904624] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.904624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.904624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.904624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.904624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.904624] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.904960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.904960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.904960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.904960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.905135] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1175.922037] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.922369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.922369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.922842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.922842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.922842] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.922842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.922984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.923023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.923107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.923179] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d is going to be updated. [ 1175.951593] env[69238]: INFO networking_nsxv3.common.synchronization [req-15d0bfb2-dc76-4e99-80ca-ad2c3bc97f2a req-5c0d2672-b50a-4cb7-a8ae-5a82073a5c15 tempest-ServersNegativeTestJSON-1827147972 tempest-ServersNegativeTestJSON-1827147972-project-member] Enqueued Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 1175.954019] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.954241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.954366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.954572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.954711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.956172] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 with Priority: HIGHEST for action security_group_members [ 1175.956536] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-78f92256-b4da-4815-aefb-cda5bc01bc11 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.956658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.956727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.957689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.958167] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.958300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.958362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.958542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.958633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.958731] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78f92256-b4da-4815-aefb-cda5bc01bc11',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.973246] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: IN_PROGRESS for 2s [ 1175.979763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.979919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.979993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.980272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.980530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.000105] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1176.148723] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.221890] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.461276] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.461497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.461621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.461900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.462115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.462445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.462560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.462637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.462831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.462917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.463020] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 is going to be updated. [ 1176.498939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.499117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.499207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.499443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.499531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.512791] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: IN_PROGRESS for 2s [ 1176.652056] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.652403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.652489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.652727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.652873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.652926] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a436812-7ebf-4b10-8e25-2625390204e8 is going to be created. [ 1176.683306] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.683306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.683494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.683631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.683953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.695201] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a436812-7ebf-4b10-8e25-2625390204e8 in Status: UNINITIALIZED for 2s [ 1176.724029] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161eb351-451d-49f3-803f-374b4ae2741c: rpc.has_security_group_logging(os_id): False [ 1176.731239] env[69238]: INFO networking_nsxv3.common.synchronization [None req-06748905-f2f1-406a-b434-7388eb684240 None None] Enqueued Resource ID: f6f07cbe-e6e7-4784-8016-2d1b715d9b2a with Priority: HIGHEST for action port [ 1176.732447] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f07cbe-e6e7-4784-8016-2d1b715d9b2a with Priority: HIGHEST for action port [ 1176.732447] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f07cbe-e6e7-4784-8016-2d1b715d9b2a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.732447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f07cbe-e6e7-4784-8016-2d1b715d9b2a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.732447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f07cbe-e6e7-4784-8016-2d1b715d9b2a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.732677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f07cbe-e6e7-4784-8016-2d1b715d9b2a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.733475] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f07cbe-e6e7-4784-8016-2d1b715d9b2a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.746775] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.746983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.747144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.747281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.747372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.747615] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.747715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.747799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.747996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.748139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.748245] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be created. [ 1176.812955] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.813179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.813179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.813421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.813572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.831042] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1176.862040] env[69238]: INFO networking_nsxv3.common.synchronization [None req-500bfa37-b2df-478a-bfab-c4d1b614a21c None None] Enqueued Resource ID: 20d976c5-e207-40dc-96e9-d64e8d91436f with Priority: HIGHEST for action port [ 1176.862040] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d976c5-e207-40dc-96e9-d64e8d91436f with Priority: HIGHEST for action port [ 1176.862040] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-20d976c5-e207-40dc-96e9-d64e8d91436f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.863810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20d976c5-e207-40dc-96e9-d64e8d91436f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.863810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20d976c5-e207-40dc-96e9-d64e8d91436f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.863810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20d976c5-e207-40dc-96e9-d64e8d91436f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.863810] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20d976c5-e207-40dc-96e9-d64e8d91436f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.235443] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6f07cbe-e6e7-4784-8016-2d1b715d9b2a [ 1177.235850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.235850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.236070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.236142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.236289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.236354] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6f07cbe-e6e7-4784-8016-2d1b715d9b2a already deleted. [ 1177.236417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f07cbe-e6e7-4784-8016-2d1b715d9b2a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.366083] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20d976c5-e207-40dc-96e9-d64e8d91436f [ 1177.366341] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.366525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.366613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.366821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.366910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.367024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20d976c5-e207-40dc-96e9-d64e8d91436f already deleted. [ 1177.367123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20d976c5-e207-40dc-96e9-d64e8d91436f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.784651] env[69238]: INFO networking_nsxv3.common.synchronization [req-8ac331e5-85a5-4777-ab29-89277f87eca0 req-58087a01-7411-40ba-a57c-62808df64bd8 tempest-ServerRescueNegativeTestJSON-1524295348 tempest-ServerRescueNegativeTestJSON-1524295348-project-member] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 1177.786085] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGHEST for action security_group_members [ 1177.786085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.786085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.786624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.786905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.787113] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.787249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.787312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.787504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.787591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.787687] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.982666] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d in Status: SUCCESS [ 1177.982666] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd8a4c5-7d49-440a-bef6-697272c0d01d deletion is rescheduled due to dependency. [ 1177.982666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd8a4c5-7d49-440a-bef6-697272c0d01d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.021639] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1178.023065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.292223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.292223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.292223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.292223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.292223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.292223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.292849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.292849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.292849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.292849] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.292849] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be updated. [ 1178.330671] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.330848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.330890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.331255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.331399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.345488] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: IN_PROGRESS for 2s [ 1178.423184] env[69238]: INFO networking_nsxv3.common.synchronization [None req-9db5f839-e692-47c1-85ab-d26b03f194b3 tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1178.423184] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1178.423440] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.423549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.423584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.424178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.424178] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.511874] env[69238]: INFO networking_nsxv3.common.synchronization [None req-40954ba8-ff83-4cf7-be5e-7d05d312688f tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1178.513013] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1178.513661] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.513778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.524131] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 in Status: SUCCESS [ 1178.524327] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78f92256-b4da-4815-aefb-cda5bc01bc11 deletion is rescheduled due to dependency. [ 1178.524453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78f92256-b4da-4815-aefb-cda5bc01bc11" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.713229] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a436812-7ebf-4b10-8e25-2625390204e8 in Status: SUCCESS [ 1178.713229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.714013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.714013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.714013] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.714013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.714013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.714013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.714305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.714305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.714305] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.780778] env[69238]: INFO networking_nsxv3.common.synchronization [None req-4f17c216-6c5d-42b7-a5c4-3bc653203a40 None None] Enqueued Resource ID: 0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98 with Priority: HIGHEST for action port [ 1178.780778] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98 with Priority: HIGHEST for action port [ 1178.781465] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.781668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.781668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.784451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.784625] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.849439] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1178.849726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.945513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.945726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.945842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.946131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.946248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.946366] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 already deleted. [ 1178.946483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.946675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.946851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.946953] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.079022] env[69238]: INFO networking_nsxv3.common.synchronization [None req-59a687fe-dcb8-4716-935c-eca6bf41954e None None] Enqueued Resource ID: f8c44d85-368b-46cb-9c23-af946cd78fbb with Priority: HIGHEST for action port [ 1179.080564] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c44d85-368b-46cb-9c23-af946cd78fbb with Priority: HIGHEST for action port [ 1179.080564] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8c44d85-368b-46cb-9c23-af946cd78fbb taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.080564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8c44d85-368b-46cb-9c23-af946cd78fbb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.080564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8c44d85-368b-46cb-9c23-af946cd78fbb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.080564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8c44d85-368b-46cb-9c23-af946cd78fbb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.080564] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8c44d85-368b-46cb-9c23-af946cd78fbb',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.218339] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.288065] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98 [ 1179.288065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.289573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.289573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.289573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.289573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.290882] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98 already deleted. [ 1179.291150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f2c2786-0f88-42f5-8ec4-cb89f0bd6a98" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.299444] env[69238]: INFO networking_nsxv3.common.synchronization [req-c8acf2f1-ae4a-4598-b564-fa30ae7fc706 req-b4b14d54-e272-4316-a137-f8d87dc13863 tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_members [ 1179.300058] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_members [ 1179.300422] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.300555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.300680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.301776] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.302402] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.302562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.303349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.303349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.303349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.304164] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.477574] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.477574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.477751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.477834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.477927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.478051] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 already deleted. [ 1179.478161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.583390] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8c44d85-368b-46cb-9c23-af946cd78fbb [ 1179.583390] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.583568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.583568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.583659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.583745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.583840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8c44d85-368b-46cb-9c23-af946cd78fbb already deleted. [ 1179.583915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8c44d85-368b-46cb-9c23-af946cd78fbb" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.724255] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a436812-7ebf-4b10-8e25-2625390204e8: rpc.has_security_group_logging(os_id): False [ 1179.748832] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.749013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.749053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.749296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.749363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.749626] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.749723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.749783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.749929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.749998] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.750155] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a436812-7ebf-4b10-8e25-2625390204e8 is going to be created. [ 1179.808685] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.809073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.809073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.809183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.809228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.809455] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.809546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.809577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.809862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.809862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.809862] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 already deleted. [ 1179.809989] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.820425] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.820425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.820425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.820425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.820425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.834034] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a436812-7ebf-4b10-8e25-2625390204e8 in Status: IN_PROGRESS for 2s [ 1179.951288] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.951288] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.951288] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.951664] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.951963] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.952959] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.953261] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.953577] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.953747] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.954059] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.954268] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.954417] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.954537] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.958028] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.958028] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.958028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.983416] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.983704] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.983907] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.984122] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.984523] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.984695] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.984847] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.985225] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.985392] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe9ed27-4b8b-4837-aa76-eb33a38aab97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.361502] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e in Status: SUCCESS [ 1180.361808] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e deletion is rescheduled due to dependency. [ 1180.361847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.488072] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.488554] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.488692] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.489081] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.489347] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.489534] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 6fe9ed27-4b8b-4837-aa76-eb33a38aab97 not found, creating... [ 1180.489850] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.490083] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.490242] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.491362] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.491525] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.491857] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.492040] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.492170] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.492415] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.492575] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.492738] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 6fe9ed27-4b8b-4837-aa76-eb33a38aab97 is going to be created. [ 1180.518265] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.518583] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.518704] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.519065] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.519387] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.519672] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.370651] env[69238]: INFO networking_nsxv3.common.synchronization [req-c8acf2f1-ae4a-4598-b564-fa30ae7fc706 req-a73ef323-c60b-41c8-838a-723c4a8c7e59 service nova] Enqueued Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_rules [ 1181.370947] env[69238]: INFO networking_nsxv3.common.synchronization [req-c8acf2f1-ae4a-4598-b564-fa30ae7fc706 req-a73ef323-c60b-41c8-838a-723c4a8c7e59 service nova] Enqueued Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_members [ 1181.371042] env[69238]: INFO networking_nsxv3.common.synchronization [req-c8acf2f1-ae4a-4598-b564-fa30ae7fc706 req-a73ef323-c60b-41c8-838a-723c4a8c7e59 service nova] Enqueued Resource ID: 6fe9ed27-4b8b-4837-aa76-eb33a38aab97 with Priority: HIGHEST for action port [ 1181.371596] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_rules [ 1181.371734] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_members [ 1181.371830] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe9ed27-4b8b-4837-aa76-eb33a38aab97 with Priority: HIGHEST for action port [ 1181.372171] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.372235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.372304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.372505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.372608] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.373910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.374053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.374122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.374291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.377456] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.377541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.377613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.377805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.377912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.378053] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.378988] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.379104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.379174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.379349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.379433] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe9ed27-4b8b-4837-aa76-eb33a38aab97',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.850025] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a436812-7ebf-4b10-8e25-2625390204e8 in Status: SUCCESS [ 1181.850025] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.888775] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.889191] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.889191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.889323] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fe9ed27-4b8b-4837-aa76-eb33a38aab97 with status ACTIVE [ 1181.889493] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.889635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.889761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.889906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.889990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.890213] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.890309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.890377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.890515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.890586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.890757] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.890843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.890901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.891056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.891131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.891211] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fe9ed27-4b8b-4837-aa76-eb33a38aab97 is going to be updated. [ 1181.914688] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.914878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.914984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.915639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.916095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.916976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe9ed27-4b8b-4837-aa76-eb33a38aab97" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.274148] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.274148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.274148] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.274413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.274553] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.274745] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.274880] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.275641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.275641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.275641] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.275831] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.275861] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.276025] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.276110] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.276239] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.276386] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.297228] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.297470] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1182.297657] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.297952] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.298380] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.298664] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.298817] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.299275] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.299481] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7d11f6-1e10-41b2-941a-cb0d6eed13bf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.394183] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.802391] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.802698] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.802805] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.803380] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.803480] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.803687] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port bd7d11f6-1e10-41b2-941a-cb0d6eed13bf not found, creating... [ 1182.804119] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.804369] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.807459] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.807459] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.807459] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.807459] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.807459] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.807764] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.807896] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.808161] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.808406] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf is going to be created. [ 1182.835070] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.835423] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.835688] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.836100] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.836576] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.837096] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.897281] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.897281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.897281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.897618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.897670] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.898737] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 is going to be created. [ 1182.926762] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.926918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.927026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.927262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.927428] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.941755] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 in Status: UNINITIALIZED for 2s [ 1183.580571] env[69238]: INFO networking_nsxv3.common.synchronization [req-08e3a838-d9e1-4372-8d68-1f7adf2cd7c7 req-5ba37417-deae-414d-9892-29d462c868d3 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1183.582096] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1183.582096] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.582096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.582096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.582096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.582492] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.582645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.582711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.582907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.582963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.583116] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.817690] env[69238]: INFO networking_nsxv3.common.synchronization [req-88cdf527-53e3-4a43-a94a-3a69786f2af8 req-4c702c49-07f6-4b45-9527-b3cd5bab7be2 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1183.818135] env[69238]: INFO networking_nsxv3.common.synchronization [req-88cdf527-53e3-4a43-a94a-3a69786f2af8 req-4c702c49-07f6-4b45-9527-b3cd5bab7be2 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1183.818135] env[69238]: INFO networking_nsxv3.common.synchronization [req-88cdf527-53e3-4a43-a94a-3a69786f2af8 req-4c702c49-07f6-4b45-9527-b3cd5bab7be2 service nova] Enqueued Resource ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf with Priority: HIGHEST for action port [ 1183.818643] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1183.819086] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1183.819086] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf with Priority: HIGHEST for action port [ 1183.822328] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.823319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.823667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.823778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.823898] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.824838] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.825137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.825137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.825309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.825309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.825309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.825309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.825309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.826297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.826297] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.831501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.831703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.831703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.831895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.831972] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7d11f6-1e10-41b2-941a-cb0d6eed13bf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.087575] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.334359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.334359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.338415] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7d11f6-1e10-41b2-941a-cb0d6eed13bf with status ACTIVE [ 1184.338647] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.338764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.338834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.339056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.339148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.339324] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.339429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.339480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.339626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.339701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.339877] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.339967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.340204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.340204] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.340308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.340381] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf is going to be updated. [ 1184.341449] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.364834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.364933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.365008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.365218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.365349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.366538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.593074] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.844797] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.952383] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 in Status: SUCCESS [ 1184.952383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.952383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.953501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.954801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.954983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.955074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.955267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.955351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.955449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.955563] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.095528] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.095805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.095805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.095987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.096258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.096258] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1185.127290] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.127290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.127290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.127290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.127290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.137417] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1185.348768] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.351309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.351309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.351309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.351309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.351309] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1185.384715] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.384715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.384715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.384715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.384715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.392207] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1185.462017] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.965788] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46081765-9c91-4ec4-ae2a-1a302b9161d1: rpc.has_security_group_logging(os_id): False [ 1185.984042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.984042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.984042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.984042] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 is going to be created. [ 1186.057349] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.057349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.057349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.057349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.057349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.067392] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 in Status: IN_PROGRESS for 2s [ 1187.135078] env[69238]: INFO networking_nsxv3.common.synchronization [req-e4a74c03-fc15-4e95-9057-dd970635f7c7 req-fdbb8f29-da50-4c68-ab63-7432f0d886a9 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 1187.136794] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 1187.136975] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.137111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.137171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.137377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.137526] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.137632] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.137694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.137809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.137888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.137979] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.151509] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1187.151509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.405450] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1187.405450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.405450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.405450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.405450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.405450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.405450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.405704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.405704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.405762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.405956] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.542242] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.542242] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.542242] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.547231] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.549598] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.549598] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.549598] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.549598] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.549598] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.549598] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.549598] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.550057] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.550057] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.550057] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.550057] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.550213] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.571626] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.571800] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.571944] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.572187] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.572626] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-a23c11fe-cff1-4ce4-82df-2355063a13d5 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.572748] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.573414] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.573414] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.573414] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a23c11fe-cff1-4ce4-82df-2355063a13d5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.642032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.642982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.643092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.643249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.666839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.667105] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.667217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.667320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.667479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.667557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.668675] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be updated. [ 1187.713361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.713361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.713361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.713361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.713361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.722119] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: IN_PROGRESS for 2s [ 1187.909939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.910194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.910266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.910479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.910693] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.910778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.910847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.911091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.911308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.911355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.912008] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.912008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.912008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.912008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.914950] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.914950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.914950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.914950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.914950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.914950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.914950] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.078440] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.078440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.078440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.078440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.078440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.078440] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port a23c11fe-cff1-4ce4-82df-2355063a13d5 not found, creating... [ 1188.078440] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.078440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.078440] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.078908] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.079445] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.079445] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.079654] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.079730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.079966] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.080165] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.080346] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: a23c11fe-cff1-4ce4-82df-2355063a13d5 is going to be created. [ 1188.087699] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 in Status: SUCCESS [ 1188.088027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.105754] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.106025] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.106185] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.106494] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.106933] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.107225] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.416571] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6984856-6c1b-4d02-a5b7-08f98ac851be: rpc.has_security_group_logging(os_id): False [ 1188.436235] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.436454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.436495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.436751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.436874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.437126] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.437259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.437389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.437685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.437879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.438283] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.438604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.438810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.439120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.439262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.439583] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.439741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.439839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.440136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.440268] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.440408] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1188.507911] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.508238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.508238] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.508392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.508522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.526928] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1188.826278] env[69238]: INFO networking_nsxv3.common.synchronization [req-e4a74c03-fc15-4e95-9057-dd970635f7c7 req-e4bab287-75b0-474f-b3d2-56c865764ce2 service nova] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_rules [ 1188.826278] env[69238]: INFO networking_nsxv3.common.synchronization [req-e4a74c03-fc15-4e95-9057-dd970635f7c7 req-e4bab287-75b0-474f-b3d2-56c865764ce2 service nova] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 1188.826278] env[69238]: INFO networking_nsxv3.common.synchronization [req-e4a74c03-fc15-4e95-9057-dd970635f7c7 req-e4bab287-75b0-474f-b3d2-56c865764ce2 service nova] Enqueued Resource ID: a23c11fe-cff1-4ce4-82df-2355063a13d5 with Priority: HIGHEST for action port [ 1188.826278] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_rules [ 1188.826278] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 1188.826278] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23c11fe-cff1-4ce4-82df-2355063a13d5 with Priority: HIGHEST for action port [ 1188.826872] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.827374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.827571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.827871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.828144] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.832462] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.832462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.832822] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a23c11fe-cff1-4ce4-82df-2355063a13d5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.832978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.833104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.833363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.833482] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a23c11fe-cff1-4ce4-82df-2355063a13d5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.335611] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.335611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.336957] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a23c11fe-cff1-4ce4-82df-2355063a13d5 with status ACTIVE [ 1189.337596] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.337596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.337596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.337596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.337837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.337837] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.337922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.338077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.338205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.338292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.338475] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.338559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.338618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.338754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.338825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.338907] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a23c11fe-cff1-4ce4-82df-2355063a13d5 is going to be updated. [ 1189.368499] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.368762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.368828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.369118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.369340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.369565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.507378] env[69238]: INFO networking_nsxv3.common.synchronization [req-048872c8-afd6-4258-8ff6-66c28bd369aa req-50009a17-37db-4b71-98fd-648bd3eefa65 tempest-InstanceActionsTestJSON-169801497 tempest-InstanceActionsTestJSON-169801497-project-member] Enqueued Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_members [ 1189.507378] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_members [ 1189.507378] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-25038b26-9f62-4166-947d-1ed4704a05a1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.507378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.507886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.509913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.509913] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.509913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.509913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.509913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.509913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.509913] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.733429] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: SUCCESS [ 1189.733429] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 deletion is rescheduled due to dependency. [ 1189.733429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.733429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.733429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.733429] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.733429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.733429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.733429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.733429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.733429] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.875742] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.875959] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.876101] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.876385] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.876650] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.876809] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.876928] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.877481] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.877666] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.877932] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.878170] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.878323] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.878466] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.878681] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.878793] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.878910] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.897916] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.898548] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.898548] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.898693] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-708" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.898999] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-82f1558c-9277-4a87-bf73-aef244aeddbf taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.899182] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.899464] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.900339] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.900339] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82f1558c-9277-4a87-bf73-aef244aeddbf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.011626] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.011777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.011858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.012167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.012364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.012547] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.012643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.012710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.012868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.012943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.013041] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25038b26-9f62-4166-947d-1ed4704a05a1 already deleted. [ 1190.013126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.235194] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.402436] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.402658] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.402717] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.403016] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.403182] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.403346] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 82f1558c-9277-4a87-bf73-aef244aeddbf not found, creating... [ 1190.403686] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.403884] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.404098] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.404350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.404498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.404785] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.404947] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.405082] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.405297] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.405435] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.405579] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 82f1558c-9277-4a87-bf73-aef244aeddbf is going to be created. [ 1190.427725] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.427965] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.428115] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.428386] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.428630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.428863] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.546310] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1190.546694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.738515] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.207531] env[69238]: INFO networking_nsxv3.common.synchronization [req-048872c8-afd6-4258-8ff6-66c28bd369aa req-fb9cd28d-f330-452b-b1f8-c6365159ca36 service nova] Enqueued Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_rules [ 1191.209472] env[69238]: INFO networking_nsxv3.common.synchronization [req-048872c8-afd6-4258-8ff6-66c28bd369aa req-fb9cd28d-f330-452b-b1f8-c6365159ca36 service nova] Enqueued Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_members [ 1191.209472] env[69238]: INFO networking_nsxv3.common.synchronization [req-048872c8-afd6-4258-8ff6-66c28bd369aa req-fb9cd28d-f330-452b-b1f8-c6365159ca36 service nova] Enqueued Resource ID: 82f1558c-9277-4a87-bf73-aef244aeddbf with Priority: HIGHEST for action port [ 1191.210548] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_rules [ 1191.215130] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_members [ 1191.215130] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82f1558c-9277-4a87-bf73-aef244aeddbf with Priority: HIGHEST for action port [ 1191.215496] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25038b26-9f62-4166-947d-1ed4704a05a1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.215689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.215791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.216157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.216283] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.218263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-25038b26-9f62-4166-947d-1ed4704a05a1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.219248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.219426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.219753] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.220069] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.220297] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.220450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.220745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.220959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.221229] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.222999] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-82f1558c-9277-4a87-bf73-aef244aeddbf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.223255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.223409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.223712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.223956] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82f1558c-9277-4a87-bf73-aef244aeddbf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.241646] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.241969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.242209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.242659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.242755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.242946] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be updated. [ 1191.316899] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.317076] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.317115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.317330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.317476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.330470] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: IN_PROGRESS for 2s [ 1191.726180] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.728630] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-25038b26-9f62-4166-947d-1ed4704a05a1 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.728766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.728996] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82f1558c-9277-4a87-bf73-aef244aeddbf with status ACTIVE [ 1191.729223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.729381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.729413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.729605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.729713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.730080] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.730080] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.730242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.730388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.730485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.730719] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.730894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.730981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.731306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.731306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.731306] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82f1558c-9277-4a87-bf73-aef244aeddbf is going to be updated. [ 1191.754840] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.754927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.754959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.755184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.755884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.755884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82f1558c-9277-4a87-bf73-aef244aeddbf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.054707] env[69238]: INFO networking_nsxv3.common.synchronization [req-4836b350-f384-4c15-886d-b26fead3da23 req-380c68ce-81b4-4d8e-8140-406e2792b2ac tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1192.055303] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1192.055606] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.055721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.055798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.056114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.056292] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.056397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.056454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.056612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.056695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.056795] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.241524] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.376564] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.376564] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.376564] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.376564] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.376564] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.377333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.377590] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.377712] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.377866] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.378112] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.378232] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.378344] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.378455] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.378563] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.378712] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.378813] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.401637] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.401637] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1192.401877] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.402019] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.402270] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.402471] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.402597] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.402936] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.403092] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa5c2603-06c4-4cc1-b215-6c3ada0a5445',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.559118] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.559389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.559805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.560314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.560395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.560610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.560743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.560817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.561014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.561122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.561315] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 already deleted. [ 1192.561373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.742926] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.743289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.743289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.743351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.743447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.743548] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25038b26-9f62-4166-947d-1ed4704a05a1 is going to be created. [ 1192.766740] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.766928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.766972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.767170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.767325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.776510] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25038b26-9f62-4166-947d-1ed4704a05a1 in Status: UNINITIALIZED for 2s [ 1192.907075] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.907075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.907075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.907075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.907075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.907458] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port fa5c2603-06c4-4cc1-b215-6c3ada0a5445 not found, creating... [ 1192.907601] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.907778] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.907907] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.908173] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.908324] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.908678] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.908843] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.908982] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.909226] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.909372] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.909519] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 is going to be created. [ 1192.932178] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.932427] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.932556] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.932842] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.933090] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.933413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.345433] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: SUCCESS [ 1193.345744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.345977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.346355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.346629] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.346797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.346892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.347120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.347240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.347360] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.347488] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.827388] env[69238]: INFO networking_nsxv3.common.synchronization [req-4836b350-f384-4c15-886d-b26fead3da23 req-6d4b85d6-109b-4b13-8c70-ffcd3a38e3e9 service nova] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1193.827716] env[69238]: INFO networking_nsxv3.common.synchronization [req-4836b350-f384-4c15-886d-b26fead3da23 req-6d4b85d6-109b-4b13-8c70-ffcd3a38e3e9 service nova] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1193.827790] env[69238]: INFO networking_nsxv3.common.synchronization [req-4836b350-f384-4c15-886d-b26fead3da23 req-6d4b85d6-109b-4b13-8c70-ffcd3a38e3e9 service nova] Enqueued Resource ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 with Priority: HIGHEST for action port [ 1193.830543] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1193.830543] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1193.830543] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 with Priority: HIGHEST for action port [ 1193.830543] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.830543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.830543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.830543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.830543] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.831090] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.831215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.831291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.831485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.831631] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.831891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.831891] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.832039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.832039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.832138] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.832949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.834709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.834810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.834959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.835043] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa5c2603-06c4-4cc1-b215-6c3ada0a5445',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.850702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.850828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.850890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.851588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.851588] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.851588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.851588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.851822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.851949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.852150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.852205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.852296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.852368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.852599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.852736] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.852826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.852924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.853584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.853673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.854053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.854161] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.337579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.337579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.337923] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.339607] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa5c2603-06c4-4cc1-b215-6c3ada0a5445 with status ACTIVE [ 1194.339870] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.340098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.340218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.340518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.340660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.340929] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.341662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.341765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.342010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.342151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.342437] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.342587] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.342684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.342890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.343013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.343153] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 is going to be updated. [ 1194.361607] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d15632cf-7f81-4a48-a43d-b6ab97d126e9: rpc.has_security_group_logging(os_id): False [ 1194.368752] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.368929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.369043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.369266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.369406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.369564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.379952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.380112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.380184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.380393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.380487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.380769] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.380887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.380887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.381040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.381116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.381353] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.381446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.381508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.381646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.381720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.381903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.381995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.382082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.382277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.382277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.382445] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be updated. [ 1194.460541] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.460692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.460816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.460979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.461193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.479178] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: IN_PROGRESS for 2s [ 1194.786963] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25038b26-9f62-4166-947d-1ed4704a05a1 in Status: SUCCESS [ 1194.787246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.787486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.787714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.787935] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.788184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.788184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.788362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.788445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.788531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.788617] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.845233] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.291672] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-25038b26-9f62-4166-947d-1ed4704a05a1 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.291985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.291985] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.292771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.292771] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.292771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.292771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.292771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.293069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.293069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.293287] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-25038b26-9f62-4166-947d-1ed4704a05a1 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.293287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.293629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.293629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.293773] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.293773] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.293933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.294030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.294235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.294235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.294384] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.347939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.348165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.348165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.348410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.348502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.348628] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 is going to be created. [ 1195.378419] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.378710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.378762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.378961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.379200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.390784] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: UNINITIALIZED for 2s [ 1195.797293] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25038b26-9f62-4166-947d-1ed4704a05a1: rpc.has_security_group_logging(os_id): False [ 1195.816570] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.816789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.816789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.817035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.817094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.817315] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.817420] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.817720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.817720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.817720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.817845] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.818055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.818116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.818253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.818320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.818505] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.818604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.818656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.818883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.818883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.818996] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25038b26-9f62-4166-947d-1ed4704a05a1 is going to be created. [ 1195.881316] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.881610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.881610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.882180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.882180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.894669] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25038b26-9f62-4166-947d-1ed4704a05a1 in Status: IN_PROGRESS for 2s [ 1196.215714] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ab7945c-3c72-4e6b-9cff-bc8ab622c01a req-89148c8c-c8dc-4695-abc8-a4575f812932 tempest-ListServerFiltersTestJSON-2137297096 tempest-ListServerFiltersTestJSON-2137297096-project-member] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1196.216352] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1196.216702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.216830] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.216896] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.217155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.217317] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.217412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.217473] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.217617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.217701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.217791] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.495361] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: SUCCESS [ 1196.495611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.619245] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.619577] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.619793] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.620351] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.620634] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.620848] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.621062] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.621289] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.621467] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.621705] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.621918] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.622835] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.622977] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.623145] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.623229] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.623381] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.645277] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.645516] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1196.645630] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.645863] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.646158] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-79f67dc4-1970-4380-87ea-c09d4974d41d taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.646459] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.646548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.646992] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.647161] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f67dc4-1970-4380-87ea-c09d4974d41d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.719998] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.720309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.720392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.720615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.720781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.721417] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.721417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.721417] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.721673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.721673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.721776] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 already deleted. [ 1196.721853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.150322] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.150659] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.150850] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.151225] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.151486] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.151646] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 79f67dc4-1970-4380-87ea-c09d4974d41d not found, creating... [ 1197.152057] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.152291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.152459] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.152766] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.152954] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.153378] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.153658] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.153739] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.154059] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.154277] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.154487] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 79f67dc4-1970-4380-87ea-c09d4974d41d is going to be created. [ 1197.192403] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.192637] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.192771] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.193109] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.193474] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.193787] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.318785] env[69238]: INFO networking_nsxv3.common.synchronization [req-29428bd4-d6fc-408b-9a14-04012eabf542 req-a52fcac8-c929-4e88-93dd-f4b12d141db4 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1197.320085] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1197.320085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.320085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.320085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.320085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.320392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.320392] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.320468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.321021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.321021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.321021] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.404268] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: SUCCESS [ 1197.404500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.404671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.405269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.405675] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.406015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.406015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.406089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.406157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.406271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.406515] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.787885] env[69238]: INFO networking_nsxv3.common.synchronization [req-d0609427-7133-4f52-a539-2e295653b1b1 req-fddef78f-2872-4fb0-b423-30fe1065f732 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 1197.788488] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGHEST for action security_group_members [ 1197.788790] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.788957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.788957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.789183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.789341] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.789440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.789575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.789640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.789720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.789812] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.822545] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.833389] env[69238]: INFO networking_nsxv3.common.synchronization [req-d0609427-7133-4f52-a539-2e295653b1b1 req-fddef78f-2872-4fb0-b423-30fe1065f732 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: a23c11fe-cff1-4ce4-82df-2355063a13d5 with Priority: HIGHEST for action port [ 1197.834242] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23c11fe-cff1-4ce4-82df-2355063a13d5 with Priority: HIGHEST for action port [ 1197.834543] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a23c11fe-cff1-4ce4-82df-2355063a13d5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.834664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.834731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.834923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.835007] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a23c11fe-cff1-4ce4-82df-2355063a13d5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.909222] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25038b26-9f62-4166-947d-1ed4704a05a1 in Status: SUCCESS [ 1197.912373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.912851] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.116717] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ab7945c-3c72-4e6b-9cff-bc8ab622c01a req-4010f579-21ed-486d-b574-8e909dc59502 service nova] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_rules [ 1198.116795] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ab7945c-3c72-4e6b-9cff-bc8ab622c01a req-4010f579-21ed-486d-b574-8e909dc59502 service nova] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1198.116967] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ab7945c-3c72-4e6b-9cff-bc8ab622c01a req-4010f579-21ed-486d-b574-8e909dc59502 service nova] Enqueued Resource ID: 79f67dc4-1970-4380-87ea-c09d4974d41d with Priority: HIGHEST for action port [ 1198.117280] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_rules [ 1198.117367] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1198.117459] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79f67dc4-1970-4380-87ea-c09d4974d41d with Priority: HIGHEST for action port [ 1198.118419] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.118646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.118702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.119644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.119644] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.120993] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.120993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.120993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.120993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.120993] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.120993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.120993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.121547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.121547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.121547] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.123114] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-79f67dc4-1970-4380-87ea-c09d4974d41d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.123114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.123114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.123114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.123114] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f67dc4-1970-4380-87ea-c09d4974d41d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.291914] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.291914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.291914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.292311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.292311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.292390] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.292734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.292734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.292734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.292857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.292857] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be updated. [ 1198.322823] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.322823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.322823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.322823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.322823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.324714] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.330949] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: IN_PROGRESS for 2s [ 1198.337367] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a23c11fe-cff1-4ce4-82df-2355063a13d5 with status ACTIVE [ 1198.338074] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.338234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.338295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.339789] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.339789] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.339789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.339789] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a23c11fe-cff1-4ce4-82df-2355063a13d5 is going to be updated. [ 1198.362887] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.363147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.363147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.363603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.363603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.363720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a23c11fe-cff1-4ce4-82df-2355063a13d5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.416369] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16b9fdef-60a6-4350-932c-d208484810e5: rpc.has_security_group_logging(os_id): False [ 1198.443740] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.443976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.443976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.444196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.444324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.444906] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.445060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.445132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.445296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.445384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.445473] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 is going to be created. [ 1198.539605] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.539778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.539894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.540202] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.540438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.554424] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: IN_PROGRESS for 2s [ 1198.624970] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.626050] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.626247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.628896] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79f67dc4-1970-4380-87ea-c09d4974d41d with status ACTIVE [ 1198.629137] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.629444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.629444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.629551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.629628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.629786] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.629901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.629968] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.630132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.630222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.630405] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.630553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.630553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.630714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.630761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.631371] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79f67dc4-1970-4380-87ea-c09d4974d41d is going to be updated. [ 1198.663278] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.663594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.663716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.664146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.664482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.664691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79f67dc4-1970-4380-87ea-c09d4974d41d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.827521] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.827521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.827697] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.827920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.828056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.828205] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1198.866817] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.866817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.866817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.866817] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.867043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.876812] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1198.914862] env[69238]: INFO networking_nsxv3.common.synchronization [req-959f0194-64b1-4100-b06d-383ff1a6e88c req-91ec8c54-f77a-4aff-8d55-82e660fdfa57 tempest-ListServerFiltersTestJSON-2137297096 tempest-ListServerFiltersTestJSON-2137297096-project-member] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1198.915561] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1198.916220] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.916220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.127284] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.274548] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.274548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.274548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.274548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.274548] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.275158] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.275295] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.275535] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.275690] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.275932] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1199.276067] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.276184] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.276294] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.276420] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1199.276849] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.277051] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.299032] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.299373] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1199.299373] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.299551] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.299921] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-c55b9717-abd8-439d-95c3-4fb5e5472914 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.300223] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.300362] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.300794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.300856] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55b9717-abd8-439d-95c3-4fb5e5472914',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.630139] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.630328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.630385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.630615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.630709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.630815] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be created. [ 1199.657603] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.657837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.657929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.658157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.658309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.669113] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: UNINITIALIZED for 2s [ 1199.811125] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.811125] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port c55b9717-abd8-439d-95c3-4fb5e5472914 not found, creating... [ 1199.811125] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.811125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.811628] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.811628] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.811628] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.815299] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.816417] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.816678] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: c55b9717-abd8-439d-95c3-4fb5e5472914 is going to be created. [ 1199.838806] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.843219] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.844085] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.844085] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.844353] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.844616] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.343249] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 in Status: SUCCESS [ 1200.343639] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 deletion is rescheduled due to dependency. [ 1200.343639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.566205] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: SUCCESS [ 1200.566205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.608257] env[69238]: INFO networking_nsxv3.common.synchronization [req-959f0194-64b1-4100-b06d-383ff1a6e88c req-a9059fe4-b040-45dd-bbef-5e2df01d5505 service nova] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_rules [ 1200.608257] env[69238]: INFO networking_nsxv3.common.synchronization [req-959f0194-64b1-4100-b06d-383ff1a6e88c req-a9059fe4-b040-45dd-bbef-5e2df01d5505 service nova] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1200.608257] env[69238]: INFO networking_nsxv3.common.synchronization [req-959f0194-64b1-4100-b06d-383ff1a6e88c req-a9059fe4-b040-45dd-bbef-5e2df01d5505 service nova] Enqueued Resource ID: c55b9717-abd8-439d-95c3-4fb5e5472914 with Priority: HIGHEST for action port [ 1200.608257] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_rules [ 1200.608257] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1200.608257] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55b9717-abd8-439d-95c3-4fb5e5472914 with Priority: HIGHEST for action port [ 1200.608257] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.608257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.608257] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.608257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.608968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c55b9717-abd8-439d-95c3-4fb5e5472914 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.609208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.609352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.609837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.609990] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55b9717-abd8-439d-95c3-4fb5e5472914',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.799028] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.799028] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.799028] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.799028] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.799904] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.800368] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.802351] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.802351] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.802351] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.802351] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.802351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.802351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.802351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.802351] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.802351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.802351] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.823490] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.823810] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.824070] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.824357] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-653" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.824859] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.825166] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.825401] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.825783] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.826035] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7d11f6-1e10-41b2-941a-cb0d6eed13bf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.888192] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1200.888433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.112721] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c55b9717-abd8-439d-95c3-4fb5e5472914 with status ACTIVE [ 1201.113164] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.113164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.113164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.113382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.113472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.113620] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.113716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.113777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.113923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.113999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.114195] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.114195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.114195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.114617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.114617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.114617] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c55b9717-abd8-439d-95c3-4fb5e5472914 is going to be updated. [ 1201.138640] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.138640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.138640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.138640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.138640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.138640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c55b9717-abd8-439d-95c3-4fb5e5472914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.233866] env[69238]: INFO networking_nsxv3.common.synchronization [req-60bf7463-ba7f-4105-8006-3edc0b70dfc0 req-5c6cf3cd-1f63-4960-b740-05bb37cbd568 tempest-ListServerFiltersTestJSON-2137297096 tempest-ListServerFiltersTestJSON-2137297096-project-member] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1201.234569] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1201.234883] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.234883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.330092] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.330377] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.330513] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.330809] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.330968] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.331377] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.331727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.331727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.331900] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.332055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.332491] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.332677] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.332802] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.333034] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.333182] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.333336] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf is going to be updated. [ 1201.361547] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.362244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.362244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.362631] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.362631] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.362960] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.621481] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.621670] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.621911] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.622088] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.622403] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.622579] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.622701] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.622915] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.623099] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.623286] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.623408] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.623592] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.623643] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.623737] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.623835] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.623972] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.644761] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.645064] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1201.645250] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.645516] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-265" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.646092] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-ec004302-134d-4ad3-8616-792b53cad539 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.646214] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.646291] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.646630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.646850] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec004302-134d-4ad3-8616-792b53cad539',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.679562] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1201.679857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.680488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.680757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.681037] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.681210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.681300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.681505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.681630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.681742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.681868] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.682924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.683213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.683464] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.683636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.683694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.683902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.684032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.684170] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.116604] env[69238]: INFO networking_nsxv3.common.synchronization [req-def6829b-e618-4bc6-b55c-3cd59fc023df req-4d28a271-80fc-4d78-aee0-b709c08aa4c2 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1202.116830] env[69238]: INFO networking_nsxv3.common.synchronization [req-def6829b-e618-4bc6-b55c-3cd59fc023df req-4d28a271-80fc-4d78-aee0-b709c08aa4c2 service nova] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1202.116830] env[69238]: INFO networking_nsxv3.common.synchronization [req-def6829b-e618-4bc6-b55c-3cd59fc023df req-4d28a271-80fc-4d78-aee0-b709c08aa4c2 service nova] Enqueued Resource ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf with Priority: HIGHEST for action port [ 1202.117135] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_rules [ 1202.117276] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1202.117370] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf with Priority: HIGHEST for action port [ 1202.119722] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.119722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.119722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.119722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.119722] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.119722] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.120551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.120551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.120551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.120551] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.120551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.120551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.120551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.120956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.120956] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.121616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.121718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.122040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.122040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.122040] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7d11f6-1e10-41b2-941a-cb0d6eed13bf',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.149139] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.149368] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.149498] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.149793] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.149946] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.150332] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port ec004302-134d-4ad3-8616-792b53cad539 not found, creating... [ 1202.151506] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.151506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.151506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.151506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.151506] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.151937] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.152018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.152181] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.152403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.152545] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.152693] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: ec004302-134d-4ad3-8616-792b53cad539 is going to be created. [ 1202.175445] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.175693] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.175825] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.176121] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.176370] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.176696] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.185903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.186139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.187650] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.625444] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.625444] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.625444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.629911] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7d11f6-1e10-41b2-941a-cb0d6eed13bf with status ACTIVE [ 1202.629911] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.629911] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.629911] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.629911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.629911] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7d11f6-1e10-41b2-941a-cb0d6eed13bf is going to be updated. [ 1202.653927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.653927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.653927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.653927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.653927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.653927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7d11f6-1e10-41b2-941a-cb0d6eed13bf" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.690661] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.126472] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.191805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.192029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.192073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.192267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.192357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.192452] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1203.209940] env[69238]: INFO networking_nsxv3.common.synchronization [req-60bf7463-ba7f-4105-8006-3edc0b70dfc0 req-9e5feb8f-4594-4929-ac29-84ea696e5098 service nova] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_rules [ 1203.210587] env[69238]: INFO networking_nsxv3.common.synchronization [req-60bf7463-ba7f-4105-8006-3edc0b70dfc0 req-9e5feb8f-4594-4929-ac29-84ea696e5098 service nova] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1203.210894] env[69238]: INFO networking_nsxv3.common.synchronization [req-60bf7463-ba7f-4105-8006-3edc0b70dfc0 req-9e5feb8f-4594-4929-ac29-84ea696e5098 service nova] Enqueued Resource ID: ec004302-134d-4ad3-8616-792b53cad539 with Priority: HIGHEST for action port [ 1203.211780] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_rules [ 1203.212016] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1203.212213] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec004302-134d-4ad3-8616-792b53cad539 with Priority: HIGHEST for action port [ 1203.212656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.212804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.213162] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.213306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.213681] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec004302-134d-4ad3-8616-792b53cad539 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.213840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.213926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.214322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.214522] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec004302-134d-4ad3-8616-792b53cad539',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.225693] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.225845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.225906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.226160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.226368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.237138] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1203.631993] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.631993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.631993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.631993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.631993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.631993] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1203.659250] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.659432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.659474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.659694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.659848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.670971] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1203.719438] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec004302-134d-4ad3-8616-792b53cad539 with status ACTIVE [ 1203.719679] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.719814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.719898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.720196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.720287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.720482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.720598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.720647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.720838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.720914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.721132] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.721229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.721290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.721434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.721526] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.721612] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec004302-134d-4ad3-8616-792b53cad539 is going to be updated. [ 1203.743087] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.743087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.743292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.747677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.747677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.747677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec004302-134d-4ad3-8616-792b53cad539" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.487603] env[69238]: INFO networking_nsxv3.common.synchronization [req-0045ee5a-6ca9-4882-882d-92ea0f8d5bd0 req-9c3ef9dd-7a10-48a7-83f5-3b8b49125f27 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1204.488221] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1204.489018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.489184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.489257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.490157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.490157] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.490157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.490157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.490157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.490157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.490157] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.992251] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.992713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.992713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.992713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.992917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.992951] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.993064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.993113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.993264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.993326] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.993416] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1205.022664] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.022887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.022995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.023317] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.023536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.034415] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1205.247516] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1205.247797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.248086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.248366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.248588] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.248749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.248821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.249047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.249175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.249284] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.680934] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1205.681199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.681373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.681588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.681779] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.681925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.681966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.682134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.682215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.682296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.682404] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.751951] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.186304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.186626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.186626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.186712] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.187414] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.187414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.187414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.187414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.187414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.187414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.187860] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.187860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.187860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.187860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.188092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.188148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.188236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.188386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.188479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.188566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.188656] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.256399] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.691440] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6984856-6c1b-4d02-a5b7-08f98ac851be: rpc.has_security_group_logging(os_id): False [ 1206.714750] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.714948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.715031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.715207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.715300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.715519] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.715614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.715667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.715813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.715908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.716130] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.716228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.716290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.716430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.716504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.716699] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.716790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.716848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.716976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.717075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.717163] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1206.761301] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.761447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.761488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.761705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.761799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.761895] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1206.782371] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.782482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.782482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.783403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.783403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.797964] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.797964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.797964] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.798247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.798280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.801030] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1206.809627] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1207.047729] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1207.048093] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1207.048261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.822068] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1208.822068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.823062] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1208.823288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.823473] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.823693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.823887] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.824087] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.824168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.824327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.824407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.824476] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.326892] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.489741] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1209.489988] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1209.830093] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.332297] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.332470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.332565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.332759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.332847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.332943] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1210.363371] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.363539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.363539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.363746] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.363966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.375598] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1210.640367] env[69238]: INFO networking_nsxv3.common.synchronization [req-3be9bb79-abdc-4418-b288-23f24fc744d9 req-5c340fc6-43ea-4d65-8505-0ca8db95164a tempest-InstanceActionsTestJSON-169801497 tempest-InstanceActionsTestJSON-169801497-project-member] Enqueued Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_members [ 1210.640367] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25038b26-9f62-4166-947d-1ed4704a05a1 with Priority: HIGHEST for action security_group_members [ 1210.640967] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-25038b26-9f62-4166-947d-1ed4704a05a1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.641156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.641247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.641610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.641720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.641845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.641924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.642125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.642233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.642357] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25038b26-9f62-4166-947d-1ed4704a05a1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.043142] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3ff24e1-bcc5-4b97-a972-0ca2f20f8a88 req-99fe003e-6709-4246-bc4e-55b3fe035c54 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1211.043674] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1211.044223] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.044223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.044367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.044481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.044632] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.044724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.044782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.044921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.045010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.045114] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.145626] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.145959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.146059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.146299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.146396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.146609] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.146715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.146778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.146929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.147013] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.147106] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25038b26-9f62-4166-947d-1ed4704a05a1 is going to be updated. [ 1211.182342] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.182604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.182725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.183058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.183298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.211569] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25038b26-9f62-4166-947d-1ed4704a05a1 in Status: IN_PROGRESS for 2s [ 1211.400799] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.401038] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.401143] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.401582] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.401862] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.402089] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.402191] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.402452] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.402611] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.402830] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.402947] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.403071] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.403183] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.403296] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.403404] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.403537] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.433326] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.433517] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1211.433694] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.434020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.434515] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.434713] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.434846] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.435263] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.435443] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c542a54a-60e9-4cdd-be9b-3fc7b2e9037d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.548080] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.938121] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.938364] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.938483] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.938786] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.938946] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.939129] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port c542a54a-60e9-4cdd-be9b-3fc7b2e9037d not found, creating... [ 1211.939467] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.939569] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.939694] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.939917] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.940102] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.940487] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.940630] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.940770] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.940901] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.941072] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.941222] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: c542a54a-60e9-4cdd-be9b-3fc7b2e9037d is going to be created. [ 1211.963583] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.963857] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.963924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.964290] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.964518] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.964752] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.050601] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.387674] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1212.387869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.388099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.388617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.388824] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.388942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.389015] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.389193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.389274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.389357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.389520] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.389598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.389662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.389797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.389936] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.390105] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.390182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.390324] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.390396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.390474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.390559] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.391411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.391569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.391716] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.391812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.391874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.392027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.392104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.392195] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.552952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.553166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.553166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.553362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.553453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.553573] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1212.583445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.583639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.583677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.583887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.584057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.595321] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1212.681631] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3ff24e1-bcc5-4b97-a972-0ca2f20f8a88 req-0cad841d-fdd0-48f0-b53f-89267eaf1fba service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1212.681824] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3ff24e1-bcc5-4b97-a972-0ca2f20f8a88 req-0cad841d-fdd0-48f0-b53f-89267eaf1fba service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1212.681969] env[69238]: INFO networking_nsxv3.common.synchronization [req-b3ff24e1-bcc5-4b97-a972-0ca2f20f8a88 req-0cad841d-fdd0-48f0-b53f-89267eaf1fba service nova] Enqueued Resource ID: c542a54a-60e9-4cdd-be9b-3fc7b2e9037d with Priority: HIGHEST for action port [ 1212.682524] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1212.682680] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1212.682749] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c542a54a-60e9-4cdd-be9b-3fc7b2e9037d with Priority: HIGHEST for action port [ 1212.684022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.684259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.684320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.684511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.684597] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.687079] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.687079] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.687585] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.687635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.687702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.687863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.687948] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c542a54a-60e9-4cdd-be9b-3fc7b2e9037d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.894463] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 307a84b6-ec60-4d35-ac8b-3997b74cc597: rpc.has_security_group_logging(os_id): False [ 1212.895822] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.914482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.914691] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.914793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.915108] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.915323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.915509] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.915645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.915785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.915935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.916106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.916349] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.916486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.916579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.916774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.917044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.917315] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.917448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.917541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.917738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.917847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.918130] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be created. [ 1212.986477] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.986723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.986723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.986982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.987164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.999277] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1213.186742] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.187282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.190430] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c542a54a-60e9-4cdd-be9b-3fc7b2e9037d with status ACTIVE [ 1213.190704] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.190848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.190919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.191227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.191321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.191523] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.191630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.191695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.191854] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.191992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.192124] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.192217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.192282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.193269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.193269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.193269] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c542a54a-60e9-4cdd-be9b-3fc7b2e9037d is going to be updated. [ 1213.223386] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25038b26-9f62-4166-947d-1ed4704a05a1 in Status: SUCCESS [ 1213.224042] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25038b26-9f62-4166-947d-1ed4704a05a1 deletion is rescheduled due to dependency. [ 1213.224175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25038b26-9f62-4166-947d-1ed4704a05a1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.230506] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.230683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.230683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.230923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.231114] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.231375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c542a54a-60e9-4cdd-be9b-3fc7b2e9037d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.399979] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.613755] env[69238]: INFO networking_nsxv3.common.synchronization [req-6882db57-3b2a-4211-b7b2-d55dba3cfbb3 req-9c212371-581a-4311-a4af-b740b31547b1 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1213.614881] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1213.614881] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.614881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.614881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.615084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.615356] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.615356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.615356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.618920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.619054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.619134] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.903322] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.903549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.903549] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.903715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.903762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.903868] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1213.952752] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.952752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.952752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.952752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.953016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.962871] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1214.021518] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.021709] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.022970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.022970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.022970] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.022970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.022970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.022970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.023281] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.023281] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.023336] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.023639] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.023639] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.023741] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.023787] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.023927] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.049339] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.049525] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.050142] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.050142] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.050274] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-0c84d262-d8de-4159-b48c-3980d4bfd493 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.050461] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.050589] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.050922] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.051099] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c84d262-d8de-4159-b48c-3980d4bfd493',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.121257] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.121439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.121557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.121734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.121828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.122042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.122138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.122197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.122352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.122444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.122534] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1214.160022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.160280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.160280] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.160483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.160639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.169035] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1214.554195] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.554553] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.554553] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.556047] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.556047] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.556047] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 0c84d262-d8de-4159-b48c-3980d4bfd493 not found, creating... [ 1214.556047] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.556047] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.556047] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.556413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.556413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.556890] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.557229] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.557406] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.557731] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.557907] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.558088] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 0c84d262-d8de-4159-b48c-3980d4bfd493 is going to be created. [ 1214.581572] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.581916] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.582143] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.582814] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.582892] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.583218] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.611335] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1214.611677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.611930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.612240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.612710] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.612710] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.612862] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.612950] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.613064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.613192] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.013565] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1215.013841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.014035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.014293] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.014383] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.115566] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.278322] env[69238]: INFO networking_nsxv3.common.synchronization [req-6882db57-3b2a-4211-b7b2-d55dba3cfbb3 req-9897714a-1389-4cdf-8751-4a552ef6938f service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1215.278639] env[69238]: INFO networking_nsxv3.common.synchronization [req-6882db57-3b2a-4211-b7b2-d55dba3cfbb3 req-9897714a-1389-4cdf-8751-4a552ef6938f service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1215.278870] env[69238]: INFO networking_nsxv3.common.synchronization [req-6882db57-3b2a-4211-b7b2-d55dba3cfbb3 req-9897714a-1389-4cdf-8751-4a552ef6938f service nova] Enqueued Resource ID: 0c84d262-d8de-4159-b48c-3980d4bfd493 with Priority: HIGHEST for action port [ 1215.279643] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1215.279847] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1215.281039] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c84d262-d8de-4159-b48c-3980d4bfd493 with Priority: HIGHEST for action port [ 1215.281039] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.281039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.281039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.281039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.281377] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.282654] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.282797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.283341] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c84d262-d8de-4159-b48c-3980d4bfd493 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.283341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.283341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.283608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.283723] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c84d262-d8de-4159-b48c-3980d4bfd493',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.516766] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.516919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.617637] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.786200] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.786356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.786538] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c84d262-d8de-4159-b48c-3980d4bfd493 with status ACTIVE [ 1215.787400] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.787400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.787400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.787400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.787400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.787400] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.787400] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.787635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.787635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.787695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.787839] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.787932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.787995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.788166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.788242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.788327] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c84d262-d8de-4159-b48c-3980d4bfd493 is going to be updated. [ 1215.811728] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.811940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.811940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.812195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.812334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.812524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c84d262-d8de-4159-b48c-3980d4bfd493" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.972919] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1215.973172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.973638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.974102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.974377] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.974536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.974626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.974850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.974961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.975094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.975216] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.122532] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.122690] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.122764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.122987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.123100] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.123203] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1216.153616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.153787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.153827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.154224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.154312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.166013] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1216.179385] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1216.179564] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1216.179671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.179826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.180184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.180271] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.180376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.180433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.180589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.180669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.180759] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.477873] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.478231] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.478366] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.478614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.478787] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.478895] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.478974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.479225] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.479355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.479495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.479697] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.479797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.479860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.480009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.480204] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.480301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.480376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.480517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.480613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.480698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.480786] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.683338] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.983802] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 307a84b6-ec60-4d35-ac8b-3997b74cc597: rpc.has_security_group_logging(os_id): False [ 1217.010891] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.011216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.011270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.011547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.011638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.012682] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.012682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.012682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.012682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.012682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.012873] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.013046] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.013209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.013393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.013527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.013787] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.013930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.014043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.014256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.014373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.014499] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1217.080115] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.080390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.080486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.080713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.080880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.096179] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1217.186226] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.697036] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.697036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.697036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.697036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.697548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.697548] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1217.745455] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.745606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.745676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.745892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.746052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.755877] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1218.178610] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1218.178865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.178978] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.179278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.179502] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.179630] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.179707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.179882] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.179965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.180145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.180249] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.682602] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.682838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.682934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.683257] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.683437] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.683541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.683605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.683788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.683877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.683973] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.684142] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.684236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.684295] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.684438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.684573] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.684662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.684720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.684853] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.684927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.685016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.685110] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.111313] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1219.111716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.111760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.111971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.112065] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.187185] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1219.207839] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.208181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.208276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.208503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.208625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.208971] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.209227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.209301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.209486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.209573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.209783] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.209883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.209956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.210267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.210362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.210594] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.210814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.210814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.210916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.210992] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.211109] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1219.276786] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.277043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.277043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.277276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.277539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.292104] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1219.614413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.614601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.614867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.614867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.614999] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.615120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.615184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.615335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.615419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.615506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.615594] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.769309] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1219.769544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.769716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.769954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.770291] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.770442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.770442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.770627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.770925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.771040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.771177] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.119636] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.120094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.120094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.120416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.120568] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.120640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.120706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.120861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.120956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.121043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.121224] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.121323] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.121383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.121528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.121729] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.121822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.121822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.121923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.121999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.122091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.122178] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.277047] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.277327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.277511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.277752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.277945] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.278182] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.278248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.278463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.278560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.278677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.278877] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.278994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.279069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.279266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.279403] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.279497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.279560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.279715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.279810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.279900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.280015] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.281066] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.281172] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1220.347318] env[69238]: INFO networking_nsxv3.common.synchronization [req-de958ada-1e2f-45eb-9c40-a6aa235bdd13 req-cb77a4e8-0035-4d67-be2e-006e3d7dbf8b tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1220.347909] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1220.348363] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.348571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.348960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.349070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.349256] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.349418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.349626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.349749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.350375] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.350375] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.625912] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 307a84b6-ec60-4d35-ac8b-3997b74cc597: rpc.has_security_group_logging(os_id): False [ 1220.644480] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.644666] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.644709] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.644908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.645009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.645210] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.645309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.645373] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.645524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.645598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.645798] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.645892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.645953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.646106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.646181] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.646388] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.646479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.646542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.646684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.646762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.646844] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1220.721421] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.721653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.721653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.721852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.721914] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.738723] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1220.783326] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b42b8e-961a-4b49-a6b3-231d9a561dc5: rpc.has_security_group_logging(os_id): False [ 1220.805484] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.805656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.805736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.806643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.806777] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.806987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.807135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.807198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.807527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.807527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.807660] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.807760] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.807826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.807990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.808077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.808273] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.808381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.808579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.808654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.810822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.810822] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1220.855353] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.881578] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.881578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.881578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.881578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.881831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.893739] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1221.305861] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1221.305861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.358765] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.862822] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.862822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.862822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.862822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.862822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.862822] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be updated. [ 1221.895147] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.895403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.895468] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.895942] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.896203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.905813] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: IN_PROGRESS for 2s [ 1222.763014] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1222.763554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.906268] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1222.906501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.915794] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1223.916141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.348648] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.349158] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1225.436266] env[69238]: INFO networking_nsxv3.common.synchronization [req-e1f8f0ab-2bdc-44ca-9a29-d6ed33a20152 req-89ace7e8-324e-4324-b43f-a92dfa464907 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1225.436842] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1225.437178] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.437374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.437440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.437641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.437799] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.437916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.437994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.441730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.441918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.442103] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.945347] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.449022] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.615891] env[69238]: INFO networking_nsxv3.common.synchronization [req-b74162bb-2379-4a74-af7e-621dfb49a0bf req-1c22708d-8a3a-4d6b-bf62-ae55674502ca tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1226.616440] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGHEST for action security_group_members [ 1226.616742] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.616864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.617036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.617140] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.617326] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.617445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.617507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.617663] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.617751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.617864] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.950723] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.951103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.951103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.951261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.951363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.951467] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1226.988330] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.988553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.988660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.988967] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.989222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.006429] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1227.120253] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.120424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.120484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.120748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.120860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.121204] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.121356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.121449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.121637] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.121717] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.121808] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be updated. [ 1227.149477] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.150243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.150243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.150243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.150243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.160916] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: IN_PROGRESS for 2s [ 1227.169386] env[69238]: INFO networking_nsxv3.common.synchronization [req-1829ef43-dd12-4605-8fd7-84a8ec6fc652 req-6d26fb9e-730d-468d-ba90-21f30270cda6 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1227.169885] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1227.172634] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.172634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.172634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.172634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.172634] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.172634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.172634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.172634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.172634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.172634] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.481763] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.482079] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.482139] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.482379] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.482640] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.482802] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.482923] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.483165] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.483322] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.483541] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.483660] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.483774] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.483889] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.484232] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.484232] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.484358] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.528087] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.528343] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1227.528490] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.528727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-656" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.529019] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-58ebbe6d-732b-453a-b8a0-946f8cc34914 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.529215] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.529433] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.529706] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.529856] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58ebbe6d-732b-453a-b8a0-946f8cc34914',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.678406] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.811747] env[69238]: INFO networking_nsxv3.common.synchronization [req-da0f424d-ba05-4573-b0b7-47f8f17ff53e req-9367fa01-21d9-4b43-a041-4143b5e54bb8 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1227.812652] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1227.813255] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.813255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.813255] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.813422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.813549] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.813647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.813707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.813858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.813943] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.814062] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.032723] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.034029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.034029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.034029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.034029] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.034248] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 58ebbe6d-732b-453a-b8a0-946f8cc34914 not found, creating... [ 1228.037031] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.037031] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.037031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.037854] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 58ebbe6d-732b-453a-b8a0-946f8cc34914 is going to be created. [ 1228.057828] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.058104] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.058211] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.058491] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.058774] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.059230] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.180273] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.317616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.317616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.317616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.317616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.317616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.317616] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.317616] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.317952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.317952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.317952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.318040] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1228.348085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.348085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.348318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.348474] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.348604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.358840] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1228.682834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.683241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.683241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.683321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.683393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.683496] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be updated. [ 1228.716273] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.720034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.720034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.720034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.720034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.720034] env[69238]: INFO networking_nsxv3.common.synchronization [req-1829ef43-dd12-4605-8fd7-84a8ec6fc652 req-adf92d8d-f617-4390-9467-11784d3291bb service nova] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 1228.720691] env[69238]: INFO networking_nsxv3.common.synchronization [req-1829ef43-dd12-4605-8fd7-84a8ec6fc652 req-adf92d8d-f617-4390-9467-11784d3291bb service nova] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1228.720691] env[69238]: INFO networking_nsxv3.common.synchronization [req-1829ef43-dd12-4605-8fd7-84a8ec6fc652 req-adf92d8d-f617-4390-9467-11784d3291bb service nova] Enqueued Resource ID: 58ebbe6d-732b-453a-b8a0-946f8cc34914 with Priority: HIGHEST for action port [ 1228.720691] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_rules [ 1228.720800] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1228.720841] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58ebbe6d-732b-453a-b8a0-946f8cc34914 with Priority: HIGHEST for action port [ 1228.723203] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.723203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.723203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.723203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.723203] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.723203] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.723203] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.723450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-58ebbe6d-732b-453a-b8a0-946f8cc34914 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.723450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.723450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.723868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.723868] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58ebbe6d-732b-453a-b8a0-946f8cc34914',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.728470] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 1228.813944] env[69238]: INFO networking_nsxv3.common.synchronization [req-ae8ca12e-ef30-4add-abcd-1e834b9d9aaf req-19d7f509-aab3-406d-b346-439b54902fba tempest-ListServerFiltersTestJSON-2137297096 tempest-ListServerFiltersTestJSON-2137297096-project-member] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1228.819696] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1228.821496] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.821793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.821893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.822603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.822855] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.822994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.823071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.823276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.823382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.823508] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.018187] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1229.018469] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.170629] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 in Status: SUCCESS [ 1229.170798] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 deletion is rescheduled due to dependency. [ 1229.170926] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.225900] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.225900] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.229427] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58ebbe6d-732b-453a-b8a0-946f8cc34914 with status ACTIVE [ 1229.229667] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.229806] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.229874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.230174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.230298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.230510] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.230589] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.230678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.230829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.230867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.231059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.231154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.231241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.231404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.231479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.231566] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58ebbe6d-732b-453a-b8a0-946f8cc34914 is going to be updated. [ 1229.260653] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.260921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.260921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.261153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.261454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.261751] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58ebbe6d-732b-453a-b8a0-946f8cc34914" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.331484] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.834285] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.337796] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.337923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.338026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.340328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.340328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.340328] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1230.370742] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1230.370963] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1230.371094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.372233] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.372233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.372458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.372510] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.372652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.383356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1230.738333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 1230.738652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.738798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.739089] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.739161] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.739311] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.739378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.739475] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.739559] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.739651] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.242327] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.743862] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.246272] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.246597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.246597] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.246799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.246918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.247260] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be updated. [ 1232.282407] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.282568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.282679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.282965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.283143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.293318] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 1232.393455] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1232.393677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.304938] env[69238]: INFO networking_nsxv3.common.synchronization [None req-1d87b29b-a625-4a8e-b7fc-c28b068e828d tempest-AttachInterfacesTestJSON-1461963537 tempest-AttachInterfacesTestJSON-1461963537-project-member] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1233.305524] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGHEST for action security_group_members [ 1233.305865] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.306135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.306723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.306723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.306866] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.306965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.308482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.308482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.308482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.308482] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.790281] env[69238]: INFO networking_nsxv3.common.synchronization [req-f964fc29-da8b-4c59-aa7d-b04e5af60e28 req-bf83f08d-5515-4a49-8759-7c970e4aec39 tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_members [ 1233.790848] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGHEST for action security_group_members [ 1233.791203] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.791340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.791407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.791615] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.792100] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.792214] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.792265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.792441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.792522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.792684] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.811819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.811819] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.811819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.812231] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be updated. [ 1233.841577] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.841731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.841887] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.842139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.842287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.851356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: IN_PROGRESS for 2s [ 1234.295958] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.296298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.296563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.296641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.299770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.299770] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.299770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.299770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.299770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.299770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.299770] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 is going to be updated. [ 1234.308204] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 1234.308481] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.308911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.309136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.309325] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.309442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.309507] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.309662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.309741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.309825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.309911] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.327043] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.327357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.327357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.327451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.328192] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.339024] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 in Status: IN_PROGRESS for 2s [ 1234.812717] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.315999] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f87108-657a-479d-b25c-126bec380d7f: rpc.has_security_group_logging(os_id): False [ 1235.335030] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.335030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.335030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.335030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.335030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.335278] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.335321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.335349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.335488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.335558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.335638] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be updated. [ 1235.399810] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.400049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.400185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.400408] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.400558] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.414784] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 1235.862531] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6984856-6c1b-4d02-a5b7-08f98ac851be in Status: SUCCESS [ 1235.862775] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be deletion is rescheduled due to dependency. [ 1235.862873] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.351713] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 in Status: SUCCESS [ 1236.351713] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 deletion is rescheduled due to dependency. [ 1236.351713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.429933] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 1237.430343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.318432] env[69238]: INFO networking_nsxv3.common.synchronization [None req-e131033d-b26d-412c-aae4-923f13bbc3df None None] Enqueued Resource ID: 903cb5d5-570d-4b5b-a5c2-a80d80bec3d0 with Priority: HIGHEST for action port [ 1238.318749] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 903cb5d5-570d-4b5b-a5c2-a80d80bec3d0 with Priority: HIGHEST for action port [ 1238.319371] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-903cb5d5-570d-4b5b-a5c2-a80d80bec3d0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.319497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-903cb5d5-570d-4b5b-a5c2-a80d80bec3d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.319563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-903cb5d5-570d-4b5b-a5c2-a80d80bec3d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.319821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-903cb5d5-570d-4b5b-a5c2-a80d80bec3d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.319904] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('903cb5d5-570d-4b5b-a5c2-a80d80bec3d0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.822593] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 903cb5d5-570d-4b5b-a5c2-a80d80bec3d0 [ 1238.822850] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.822952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.823027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.823251] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.823345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.823440] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:903cb5d5-570d-4b5b-a5c2-a80d80bec3d0 already deleted. [ 1238.823520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-903cb5d5-570d-4b5b-a5c2-a80d80bec3d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.401946] env[69238]: INFO networking_nsxv3.common.synchronization [req-d4265beb-a057-43dc-9c78-f4691377f5a4 req-258ae4eb-8ae7-4369-a397-d1c13e47073b tempest-ListServerFiltersTestJSON-2137297096 tempest-ListServerFiltersTestJSON-2137297096-project-member] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1239.402706] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1239.402965] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.403099] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.403162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.403355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.403503] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.403596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.403656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.403820] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.403871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.403961] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.906726] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.411375] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.455271] env[69238]: INFO networking_nsxv3.common.synchronization [None req-d2a5c6ae-929e-41d8-9232-a4dd17956b7e None None] Enqueued Resource ID: 03655f56-56a3-4c1f-b0ce-9d34e8748f20 with Priority: HIGHEST for action port [ 1240.456154] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03655f56-56a3-4c1f-b0ce-9d34e8748f20 with Priority: HIGHEST for action port [ 1240.456154] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-03655f56-56a3-4c1f-b0ce-9d34e8748f20 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.456287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03655f56-56a3-4c1f-b0ce-9d34e8748f20" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.456336] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03655f56-56a3-4c1f-b0ce-9d34e8748f20" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.457726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03655f56-56a3-4c1f-b0ce-9d34e8748f20" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.457726] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03655f56-56a3-4c1f-b0ce-9d34e8748f20',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.601616] env[69238]: INFO networking_nsxv3.common.synchronization [req-9c2636b7-1f53-47df-89f5-343c1bd96cdd req-4833a676-07b6-4260-9c36-e67862bf710d tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1240.602200] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1240.602521] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.602641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.602703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.602894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.603336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.603509] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.603596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.603790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.603927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.604192] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.914134] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.914924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.914924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.914924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.914924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.914924] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1240.946513] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.946513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.946671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.947036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.947153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.956735] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1240.960185] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03655f56-56a3-4c1f-b0ce-9d34e8748f20 [ 1240.960544] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.960683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.960757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.961043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.961291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.961391] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03655f56-56a3-4c1f-b0ce-9d34e8748f20 already deleted. [ 1240.961497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03655f56-56a3-4c1f-b0ce-9d34e8748f20" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.012503] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.012827] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.012827] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.013103] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.013372] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.013534] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.013654] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.013868] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.015296] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.016837] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1241.016978] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1241.017115] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1241.017232] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1241.017353] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1241.017464] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1241.017626] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.037845] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.038530] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1241.038530] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.038530] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-497" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.038735] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-dee233ec-bc29-4aa3-a845-c2c731ea38b0 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.038841] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.038972] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.039357] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.039494] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dee233ec-bc29-4aa3-a845-c2c731ea38b0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.107357] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.545044] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.545227] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.545375] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.545700] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.545936] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.546194] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port dee233ec-bc29-4aa3-a845-c2c731ea38b0 not found, creating... [ 1241.546533] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.546735] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.546893] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.547192] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.547369] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.547695] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.547908] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.548092] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.548350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.548501] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.548649] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: dee233ec-bc29-4aa3-a845-c2c731ea38b0 is going to be created. [ 1241.573018] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.573296] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.573422] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.573697] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.573980] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.574190] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.609909] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.112413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.112784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.112784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.112784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.112876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.112971] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1242.140587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.140821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.140821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.140994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.141191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.150813] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1242.425584] env[69238]: INFO networking_nsxv3.common.synchronization [req-9c2636b7-1f53-47df-89f5-343c1bd96cdd req-27eeff39-0279-4335-a9fb-cca6e6b493f2 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1242.425584] env[69238]: INFO networking_nsxv3.common.synchronization [req-9c2636b7-1f53-47df-89f5-343c1bd96cdd req-27eeff39-0279-4335-a9fb-cca6e6b493f2 service nova] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1242.425584] env[69238]: INFO networking_nsxv3.common.synchronization [req-9c2636b7-1f53-47df-89f5-343c1bd96cdd req-27eeff39-0279-4335-a9fb-cca6e6b493f2 service nova] Enqueued Resource ID: dee233ec-bc29-4aa3-a845-c2c731ea38b0 with Priority: HIGHEST for action port [ 1242.425584] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_rules [ 1242.425584] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1242.425584] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dee233ec-bc29-4aa3-a845-c2c731ea38b0 with Priority: HIGHEST for action port [ 1242.425584] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.425584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.425584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.425584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.425584] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.427067] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.427330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.427692] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-dee233ec-bc29-4aa3-a845-c2c731ea38b0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.427947] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.428153] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.428456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.428649] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dee233ec-bc29-4aa3-a845-c2c731ea38b0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.931576] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.931680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.931839] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dee233ec-bc29-4aa3-a845-c2c731ea38b0 with status ACTIVE [ 1242.932018] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.932131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.932197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.932401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.932492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.932664] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.932792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.932835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.932970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.933059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.933268] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.933346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.933380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.933518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.933669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.933669] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dee233ec-bc29-4aa3-a845-c2c731ea38b0 is going to be updated. [ 1242.956874] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.957524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.957524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.957524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.957524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.957661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dee233ec-bc29-4aa3-a845-c2c731ea38b0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.966952] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1242.967249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.160703] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1244.161071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.161121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.161402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.161608] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.161742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.161809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.161988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.162081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.162187] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.664413] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.875778] env[69238]: INFO networking_nsxv3.common.synchronization [req-3551dc0f-411d-4dc0-89be-6217555814a5 req-80840a71-a197-4109-8db9-8ece6c2a0745 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1244.876284] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1244.876581] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.876722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.876791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.876987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.877393] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.877502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.877562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.877742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.877828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.877917] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.171415] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.204689] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.204921] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.205092] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.205380] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.205655] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.205818] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.205940] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.206285] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.206344] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.206741] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1245.206807] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1245.206873] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1245.206997] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1245.207187] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1245.207325] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1245.207505] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1245.233926] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1245.234167] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1245.234301] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1245.234481] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.234805] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-24a30830-cd53-4a4f-ab21-a9e8862db2aa taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.234972] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.235115] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.235456] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.235599] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24a30830-cd53-4a4f-ab21-a9e8862db2aa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.380407] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.380593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.380682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.381035] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.381120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.381487] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.381487] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.381627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.381715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.381793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.381879] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1245.403386] env[69238]: INFO networking_nsxv3.common.synchronization [req-da89b070-1d58-4564-9ea1-abda63c1ad90 req-408053f3-5aec-4bd3-b7ab-46d49ce0cc08 tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_members [ 1245.403907] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGHEST for action security_group_members [ 1245.404220] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.404335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.404399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.404576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.404720] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.404831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.404890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.405059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.405143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.405235] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.408998] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.409147] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.409209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.409393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.409530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.420624] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1245.673994] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.674176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.674262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.674450] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.674661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.674661] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1245.704347] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.704542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.704542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.704752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.704894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.714325] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1245.738648] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.738857] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.738985] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.739348] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.739515] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.739680] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 24a30830-cd53-4a4f-ab21-a9e8862db2aa not found, creating... [ 1245.739953] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.740235] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.740373] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.740605] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.740751] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.742476] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.742729] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.742870] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.743120] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.743458] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.743458] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 24a30830-cd53-4a4f-ab21-a9e8862db2aa is going to be created. [ 1245.765228] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.765591] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.765819] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.766244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.766651] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.766987] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.908189] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.908189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.908189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.908494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.908561] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.908801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.908959] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.909081] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.909321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.909465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.909602] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c767742c-a318-4de7-875d-b9006231b601 is going to be updated. [ 1245.944091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.944291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.944332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.944638] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.944908] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.958897] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: IN_PROGRESS for 2s [ 1246.450838] env[69238]: INFO networking_nsxv3.common.synchronization [req-3551dc0f-411d-4dc0-89be-6217555814a5 req-6d48e969-442d-4879-8e8b-6e5acf32c7ea service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1246.451132] env[69238]: INFO networking_nsxv3.common.synchronization [req-3551dc0f-411d-4dc0-89be-6217555814a5 req-6d48e969-442d-4879-8e8b-6e5acf32c7ea service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1246.451389] env[69238]: INFO networking_nsxv3.common.synchronization [req-3551dc0f-411d-4dc0-89be-6217555814a5 req-6d48e969-442d-4879-8e8b-6e5acf32c7ea service nova] Enqueued Resource ID: 24a30830-cd53-4a4f-ab21-a9e8862db2aa with Priority: HIGHEST for action port [ 1246.452502] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1246.452705] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1246.452859] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a30830-cd53-4a4f-ab21-a9e8862db2aa with Priority: HIGHEST for action port [ 1246.453285] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.453463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.453555] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.454419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.454543] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.455795] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.455928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.456224] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-24a30830-cd53-4a4f-ab21-a9e8862db2aa taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.456380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.456465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.456703] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.456975] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24a30830-cd53-4a4f-ab21-a9e8862db2aa',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.959671] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.959671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.959978] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24a30830-cd53-4a4f-ab21-a9e8862db2aa with status ACTIVE [ 1246.959978] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.960113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.960352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.960434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.960522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.960689] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.960836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.960836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.960980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.961071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.961484] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.961484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.961484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.961588] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.961658] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.961686] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24a30830-cd53-4a4f-ab21-a9e8862db2aa is going to be updated. [ 1246.983936] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.983936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.984060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.984270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.984463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.984642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24a30830-cd53-4a4f-ab21-a9e8862db2aa" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.433026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1247.433247] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1247.433462] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.433656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.433884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.434082] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.434201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.434265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.434422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.434527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.434598] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.724719] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1247.725029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.725157] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.725371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.725566] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.725681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.725747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.725898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.725979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.726077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.726167] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.938073] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.969286] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c767742c-a318-4de7-875d-b9006231b601 in Status: SUCCESS [ 1247.969478] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c767742c-a318-4de7-875d-b9006231b601 deletion is rescheduled due to dependency. [ 1247.969595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.228845] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.229090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.229277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.229548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.229834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.230051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.230193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.230412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.230492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.230582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.230729] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.230835] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.230924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.231216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.231376] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.231511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.231605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.231692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.231812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.231902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.231981] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.441285] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.734664] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adcaa282-9bd0-4318-8903-fc1e657e143d: rpc.has_security_group_logging(os_id): False [ 1248.754825] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.755084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.755142] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.755431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.755566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.755914] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.756053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.756104] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.756270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.756364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.756597] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.756701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.756765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.756913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.756990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.757205] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.757315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.757384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.757591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.757859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.757859] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1248.817269] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.817436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.817517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.817725] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.817879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.834018] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1248.943717] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.944137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.944137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.944389] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.944527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.944661] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1248.998622] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.998852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.998852] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.999092] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.999313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.008159] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1250.849977] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1250.850453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.923692] env[69238]: INFO networking_nsxv3.common.synchronization [req-3aa94131-d8c9-482c-b024-ed26e54118dc req-7c39ffb3-481b-40f2-9e04-9f72fe27c3bf tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_members [ 1250.923692] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGHEST for action security_group_members [ 1250.923692] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.923692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.923692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.923692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.924152] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.924439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.924643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.925628] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.925826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.926025] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.022785] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1251.022785] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.023057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.023205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.024234] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.024234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.024234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.024234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.024234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.024234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.024234] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.429433] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.432128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.432128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.432128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.468828] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.468828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.469163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.469163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.469418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.469600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.469643] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 is going to be updated. [ 1251.515399] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.515673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.515755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.517341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.517341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.526482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.526698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.526850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.527122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.527304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.527413] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.527478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.527633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.527719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.527807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.527953] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.528207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.528207] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.528377] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.528765] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.528765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.528907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.528941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.529010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.529134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.529279] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.531050] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 in Status: IN_PROGRESS for 2s [ 1252.032601] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b42b8e-961a-4b49-a6b3-231d9a561dc5: rpc.has_security_group_logging(os_id): False [ 1252.056392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.056546] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.056611] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.056818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.056913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.057118] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.057220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.057286] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.057443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.057520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.057723] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.057816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.057876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.058023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.058122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.058310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.058403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.058463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.058598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.058670] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.058753] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1252.139345] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.139604] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.139678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.139893] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.140072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.156307] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1253.543586] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 in Status: SUCCESS [ 1253.544063] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 deletion is rescheduled due to dependency. [ 1253.544158] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.169468] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1254.169781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.921908] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.921908] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1256.142221] env[69238]: INFO networking_nsxv3.common.synchronization [req-3f4b4646-75b6-4ed3-9bd5-3d47b55efc64 req-ebffdcd8-b724-478b-bff8-27eeadabfe67 tempest-ListServerFiltersTestJSON-2137297096 tempest-ListServerFiltersTestJSON-2137297096-project-member] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1256.143179] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGHEST for action security_group_members [ 1256.143605] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.143605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.143605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.143883] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.144584] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.144584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.144584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.144584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.144584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.144584] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.610668] env[69238]: INFO networking_nsxv3.common.synchronization [req-dc8edf04-a2f4-40a3-97df-dc897e4ceaf1 req-bd804b2f-7df4-47ad-93ba-79a42f63a10b tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1256.610668] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1256.611524] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.611524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.611524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.611524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.611801] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.611801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.611801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.611936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.611980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.612113] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.647444] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.647640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.653021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.653021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.653021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.653021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.653021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.653021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.653021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.653021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.653021] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be updated. [ 1256.687456] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.687689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.687766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.688185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.688455] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.704508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: IN_PROGRESS for 2s [ 1256.756926] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-a141db23-9fe7-4f81-8974-479c1a887b0a tempest-ListServersNegativeTestJSON-871674043 tempest-ListServersNegativeTestJSON-871674043-project-member] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1256.757455] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1256.757771] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.757925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.757996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.761669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.761912] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.762056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.762221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.762404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.762458] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.762558] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.115155] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.191729] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.192672] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.192672] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.192672] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.192904] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.193014] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.194076] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.194076] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.194076] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.194076] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.194076] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.194833] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.194833] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.194833] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.194833] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.194833] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.216019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.216019] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1257.216930] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.216930] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.216930] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-f1b546b3-e7de-4906-bfe3-cba00de78865 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.216930] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.217131] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.219636] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.219636] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b546b3-e7de-4906-bfe3-cba00de78865',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.265359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.266550] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.266550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.266550] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d already deleted. [ 1257.267078] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.618801] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.720495] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.720743] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.720898] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.721246] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.721406] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.721569] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port f1b546b3-e7de-4906-bfe3-cba00de78865 not found, creating... [ 1257.721886] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.722075] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.722203] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.722446] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.722606] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.722896] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.723083] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.723221] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.723436] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.723581] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.723818] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: f1b546b3-e7de-4906-bfe3-cba00de78865 is going to be created. [ 1257.754567] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.754937] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.755127] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.755522] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.755838] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.756120] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.121727] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.121727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.121727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.122135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.122135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.122135] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1258.153099] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.153283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.153327] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.153542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.153689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.167734] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1258.549915] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-ef138b9c-8bee-495f-aba5-468640ad781f service nova] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_rules [ 1258.550290] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-ef138b9c-8bee-495f-aba5-468640ad781f service nova] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1258.550562] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-ef138b9c-8bee-495f-aba5-468640ad781f service nova] Enqueued Resource ID: f1b546b3-e7de-4906-bfe3-cba00de78865 with Priority: HIGHEST for action port [ 1258.552877] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_rules [ 1258.553197] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1258.553354] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b546b3-e7de-4906-bfe3-cba00de78865 with Priority: HIGHEST for action port [ 1258.553855] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.554244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.554548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.554855] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.554960] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.555967] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.556184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.556425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.557250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.560424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.560424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.560424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.560424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.560424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.560424] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.560424] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b546b3-e7de-4906-bfe3-cba00de78865 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.560424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.560424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.560424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.560424] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b546b3-e7de-4906-bfe3-cba00de78865',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.715812] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 in Status: SUCCESS [ 1258.716017] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 deletion is rescheduled due to dependency. [ 1258.716135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.901437] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-4b5ce74e-34fb-4424-821a-809cceffb4a4 tempest-ListServersNegativeTestJSON-871674043 tempest-ListServersNegativeTestJSON-871674043-project-member] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1258.902027] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1258.902339] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.902444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.061096] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.061309] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.062624] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.063594] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1b546b3-e7de-4906-bfe3-cba00de78865 with status ACTIVE [ 1259.063808] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.063945] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.064042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.064287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.064403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.064612] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.064735] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.064816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.065012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.065112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.065330] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.065451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.065529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.065790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.065790] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.065879] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1b546b3-e7de-4906-bfe3-cba00de78865 is going to be updated. [ 1259.087712] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.087886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.087957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.088248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.088388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.088577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b546b3-e7de-4906-bfe3-cba00de78865" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.568590] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.993050] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.993050] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.993358] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.993419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.993722] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.993891] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.993979] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.994245] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.994371] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.994657] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.994782] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.994899] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.995018] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.995147] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.995248] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.995415] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.014997] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.014997] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1260.014997] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.014997] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.015325] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-5aaa3272-5b01-411c-9af5-160c64f780d0 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.015325] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.015449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.016023] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.016150] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aaa3272-5b01-411c-9af5-160c64f780d0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.071085] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.071442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.071442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.071617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.071742] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.071944] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be created. [ 1260.096159] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.096159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.096288] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.097060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.097060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.107237] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: UNINITIALIZED for 2s [ 1260.184616] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1260.184836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.518459] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.518682] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.518811] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.519115] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.519267] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.519424] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 5aaa3272-5b01-411c-9af5-160c64f780d0 not found, creating... [ 1260.519681] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.519835] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.519955] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.520237] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.520381] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.520664] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.520821] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.520942] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.521163] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.521298] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.521440] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 5aaa3272-5b01-411c-9af5-160c64f780d0 is going to be created. [ 1260.542059] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.542331] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.542492] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.542802] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.543071] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.543316] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.744576] env[69238]: INFO networking_nsxv3.common.synchronization [req-342ba465-52b5-4047-b6e5-1619ace3c612 req-5e71105e-84a7-4fa6-9531-888095afadbd tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1260.745180] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1260.745581] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.745756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.747956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.747956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.747956] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.747956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.747956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.747956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.747956] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.747956] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.249413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.249584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.249657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.249881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.249977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.250208] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.250320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.250382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.250533] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.250608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.250692] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1261.280354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.280579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.280579] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.280784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.280923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.289820] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1261.362538] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-cf77f9e8-b127-4c7a-98cd-9a7859a359de service nova] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_rules [ 1261.362805] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-cf77f9e8-b127-4c7a-98cd-9a7859a359de service nova] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1261.362902] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-cf77f9e8-b127-4c7a-98cd-9a7859a359de service nova] Enqueued Resource ID: 5aaa3272-5b01-411c-9af5-160c64f780d0 with Priority: HIGHEST for action port [ 1261.363477] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_rules [ 1261.363617] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1261.363720] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aaa3272-5b01-411c-9af5-160c64f780d0 with Priority: HIGHEST for action port [ 1261.363993] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.364306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.364579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.364734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.364966] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aaa3272-5b01-411c-9af5-160c64f780d0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.368034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.368034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.368034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.368034] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aaa3272-5b01-411c-9af5-160c64f780d0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.796129] env[69238]: INFO networking_nsxv3.common.synchronization [None req-f4f801d2-8e22-48e5-92ab-cb8f6d747d6f tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_rules [ 1261.796482] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_rules [ 1261.796833] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.796953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.797082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.797344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.797427] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.867584] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aaa3272-5b01-411c-9af5-160c64f780d0 with status ACTIVE [ 1261.867877] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.868022] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.868095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.868289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.868386] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.868576] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.868681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.868731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.868890] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.868970] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.869157] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.869252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.869314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.869447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.869524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.869678] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aaa3272-5b01-411c-9af5-160c64f780d0 is going to be updated. [ 1261.896195] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.896414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.896491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.896706] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.896874] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.897053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aaa3272-5b01-411c-9af5-160c64f780d0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.902658] env[69238]: INFO networking_nsxv3.common.synchronization [None req-c6641f1e-fae7-4899-941e-80da4e6d7d54 tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_rules [ 1261.904367] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_rules [ 1261.904367] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.904367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.000829] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-c43adf71-5ac9-47e5-a293-acecdb1e65bb tempest-ListServersNegativeTestJSON-871674043 tempest-ListServersNegativeTestJSON-871674043-project-member] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1262.001408] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1262.001710] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.001864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.118781] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1262.118781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.118781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.118938] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.119144] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.119253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.119319] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.119478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.119562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.119644] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.321799] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.322012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.322012] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.322235] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.322395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.322489] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b already deleted. [ 1262.322489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.322660] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.322782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.322869] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.614187] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.614187] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.614187] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.614187] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.614187] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.614187] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.615449] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.616355] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.616563] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.616929] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.619076] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.619076] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.619076] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.619076] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.619076] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.619076] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.621313] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.646184] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.646184] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1262.646184] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.646184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-62" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.646184] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-45be6fc8-cc7c-4b7a-80a6-56bca382e584 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.646184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.646184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.646184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.646184] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45be6fc8-cc7c-4b7a-80a6-56bca382e584',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.847330] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.847330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.847330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.847330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.847330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.847330] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b already deleted. [ 1262.847330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.124245] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.148798] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.149037] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.149174] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.149493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.149703] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.149895] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 45be6fc8-cc7c-4b7a-80a6-56bca382e584 not found, creating... [ 1263.150151] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.150378] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.150513] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.150747] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.150892] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.151284] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.151359] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.152058] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.152058] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.152058] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.152058] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 45be6fc8-cc7c-4b7a-80a6-56bca382e584 is going to be created. [ 1263.171408] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.172093] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.172093] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.172093] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.172391] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.172518] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.301473] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1263.301675] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1263.301795] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.629049] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.629243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.629243] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.629464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.629560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.629659] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1263.664932] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.664932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.664932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.665149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.665149] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.677267] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1263.886537] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-ac777d8b-f2e2-4e96-bc84-7cf30528568f service nova] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_rules [ 1263.886946] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-ac777d8b-f2e2-4e96-bc84-7cf30528568f service nova] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1263.887770] env[69238]: INFO networking_nsxv3.common.synchronization [req-6fb56ce0-202e-4693-b8ad-0e1185c2dd62 req-ac777d8b-f2e2-4e96-bc84-7cf30528568f service nova] Enqueued Resource ID: 45be6fc8-cc7c-4b7a-80a6-56bca382e584 with Priority: HIGHEST for action port [ 1263.887770] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_rules [ 1263.887924] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1263.887924] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45be6fc8-cc7c-4b7a-80a6-56bca382e584 with Priority: HIGHEST for action port [ 1263.888305] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.888443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.888706] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.888845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.889111] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-45be6fc8-cc7c-4b7a-80a6-56bca382e584 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.889471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.889471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.889719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.889783] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45be6fc8-cc7c-4b7a-80a6-56bca382e584',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.394028] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45be6fc8-cc7c-4b7a-80a6-56bca382e584 with status ACTIVE [ 1264.394028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.394028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.394028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.394308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.394308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.394534] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.394641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.394707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.395748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.395748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.395748] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.395748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.395748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.395748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.395748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.395748] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45be6fc8-cc7c-4b7a-80a6-56bca382e584 is going to be updated. [ 1264.417883] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.418051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.418145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.418380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.420521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.420521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45be6fc8-cc7c-4b7a-80a6-56bca382e584" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.036022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.036022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.036022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.036022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.036022] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.036022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.036022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.036022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.036970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.037385] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1265.039351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1265.039351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1265.039351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1265.039351] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1265.039351] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1265.039351] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1265.057544] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1265.058490] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1265.058490] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1265.058490] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-292" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.058490] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.058753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.058753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.058969] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.059114] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc43ac23-78b7-4cc4-819e-d6e6a539d30a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.563258] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.563470] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.563470] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.563779] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.563955] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.564277] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.564446] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.564569] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.564803] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.564941] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.565260] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.565434] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.565540] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.565753] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.565893] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.566050] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a is going to be updated. [ 1265.591449] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.591836] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.592069] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.592436] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.592680] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.592927] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.694233] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1265.694476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.694662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.694940] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.695174] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.695346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.695434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.695582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.695693] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.695743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.695852] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.697052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.697190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.697349] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.697466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.697564] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.697744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.697798] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.697896] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.199915] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.200738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.200738] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.414514] env[69238]: INFO networking_nsxv3.common.synchronization [req-10443374-f21c-47af-aeb4-e9af3b232771 req-2b230566-9512-4fa9-b132-34042f950d1f service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 1266.414514] env[69238]: INFO networking_nsxv3.common.synchronization [req-10443374-f21c-47af-aeb4-e9af3b232771 req-2b230566-9512-4fa9-b132-34042f950d1f service nova] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1266.414744] env[69238]: INFO networking_nsxv3.common.synchronization [req-10443374-f21c-47af-aeb4-e9af3b232771 req-2b230566-9512-4fa9-b132-34042f950d1f service nova] Enqueued Resource ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a with Priority: HIGHEST for action port [ 1266.415015] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_rules [ 1266.415015] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1266.415122] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a with Priority: HIGHEST for action port [ 1266.416158] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.416378] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.416466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.416731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.416785] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.418309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.418409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.418465] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.418653] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.418815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.418912] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.418965] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.419131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.419221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.419312] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.423131] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.423131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.423131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.423131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.423131] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc43ac23-78b7-4cc4-819e-d6e6a539d30a',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.702274] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.922910] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.923325] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.923466] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.924953] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc43ac23-78b7-4cc4-819e-d6e6a539d30a with status ACTIVE [ 1266.925139] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.925277] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.925346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.925569] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.925664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.925846] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.925957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.926029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.926241] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.926301] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.926553] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.926553] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.926752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.926752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.926814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.926854] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc43ac23-78b7-4cc4-819e-d6e6a539d30a is going to be updated. [ 1266.968296] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.968501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.968619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.969033] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.969144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.969380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc43ac23-78b7-4cc4-819e-d6e6a539d30a" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.206991] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.206991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.206991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.206991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.206991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.206991] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1267.236608] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.236949] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.238451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.238451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.238451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.250179] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1267.425255] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.926839] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.927064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.927176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.927696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.927696] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.927934] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 1267.964173] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.964173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.964173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.964173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.964173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.973950] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1268.207571] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0f38e4dc-c363-4efa-89f2-9a0e22272198 tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_rules [ 1268.208309] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_rules [ 1268.209034] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.209034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.209034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.210278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.210930] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.299116] env[69238]: INFO networking_nsxv3.common.synchronization [None req-3208ae2c-ca0a-45cb-add4-69daac623aa6 tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_rules [ 1268.299735] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_rules [ 1268.300097] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.300281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.731900] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.732136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.732136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.732339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.732446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.732553] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad already deleted. [ 1268.732644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.732832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.733017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.733109] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.257303] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.257303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.257639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.257639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.257724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.257767] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad already deleted. [ 1269.257822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.261039] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1269.261239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.261405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.261591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.261762] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.261870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.261933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.262093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.262170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.262271] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.765300] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.987548] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1269.987779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.987931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.988160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.988353] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.988467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.988531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.988681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.988761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.988844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.988930] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.267902] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.491713] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.769901] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.770070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.770143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.770399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.770490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.770594] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1270.801183] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.801371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.801439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.801641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.801783] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.810426] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1270.994102] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 161eb351-451d-49f3-803f-374b4ae2741c: rpc.has_security_group_logging(os_id): False [ 1271.013778] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.013971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.014060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.014387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.014521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.014952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.014952] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.015083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.015174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.015285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.015419] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 1271.078330] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.078330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.078330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.078622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.078622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.093753] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1271.913261] env[69238]: INFO networking_nsxv3.common.synchronization [req-6941341b-a978-41bf-b5ce-841f6f27f69a req-63b42142-7113-4f5f-9bd9-26ca50d5c0e7 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_members [ 1271.914345] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a436812-7ebf-4b10-8e25-2625390204e8 with Priority: HIGHEST for action security_group_members [ 1271.914345] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a436812-7ebf-4b10-8e25-2625390204e8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.914345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.914345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.914652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.914757] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.914927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.914996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.915165] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.915287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.915435] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a436812-7ebf-4b10-8e25-2625390204e8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.418052] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.418206] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.418341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.418608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.418754] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.419078] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.419248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.419419] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.419610] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.419747] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.419903] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a436812-7ebf-4b10-8e25-2625390204e8 is going to be updated. [ 1272.453056] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.453056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.453056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.453056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.453056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.463335] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a436812-7ebf-4b10-8e25-2625390204e8 in Status: IN_PROGRESS for 2s [ 1272.825184] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1272.825436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.825626] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.825892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.826148] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.826322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.826427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.826607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.826695] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.826795] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.107769] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1273.108130] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.331470] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.641208] env[69238]: INFO networking_nsxv3.common.synchronization [req-ebd9ce80-8f08-4bb1-a167-eb3d47558a0a req-28dc37ec-c845-4936-b683-f05165333fc0 tempest-ListServersNegativeTestJSON-871674043 tempest-ListServersNegativeTestJSON-871674043-project-member] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1273.641302] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1273.642026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.642026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.834033] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.335592] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.335961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.335961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.336049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.336185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.336376] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1274.369454] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.369669] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.369802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.370060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.370287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.380924] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1274.474861] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a436812-7ebf-4b10-8e25-2625390204e8 in Status: SUCCESS [ 1274.475241] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a436812-7ebf-4b10-8e25-2625390204e8 deletion is rescheduled due to dependency. [ 1274.475380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a436812-7ebf-4b10-8e25-2625390204e8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.004561] env[69238]: INFO networking_nsxv3.common.synchronization [req-e8faa8dc-7208-4424-aa50-16e855412c15 req-d05affd5-fa58-424a-8fe8-60cdad5f6e59 tempest-ServersTestJSON-82089053 tempest-ServersTestJSON-82089053-project-member] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1275.004561] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGHEST for action security_group_members [ 1275.004561] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.005771] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.005906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.006187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.006462] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.006609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.006675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.006867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.006962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.007595] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.510217] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.510677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.510677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.510677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.510781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.511015] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.511143] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.511199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.511350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.511421] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.511535] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be updated. [ 1275.538475] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.538617] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.538698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.538901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.539073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.549152] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: IN_PROGRESS for 2s [ 1276.390688] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1276.390897] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.391090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.391312] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.391533] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.391655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.391722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.391880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.391962] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.392060] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.392253] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.392395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.392395] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.392498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.392662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.392775] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.392881] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.392936] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.393018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.393097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.393181] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.394027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.394190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.394334] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.394433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.394496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.394631] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.394810] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.394810] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.896993] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 986357b7-fd8b-4c3b-b87c-f49b9cd2664d: rpc.has_security_group_logging(os_id): False [ 1276.898203] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.916797] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.916974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.916974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.917302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.917403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.917600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.917708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.917772] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.917925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.918007] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.918228] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.918335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.918424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.918583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.919600] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.919868] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.919977] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.920058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.920212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.920303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.920398] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be created. [ 1277.007517] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.007677] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.007729] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.007937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.008190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.031353] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1277.401477] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.561758] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adcaa282-9bd0-4318-8903-fc1e657e143d in Status: SUCCESS [ 1277.562043] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d deletion is rescheduled due to dependency. [ 1277.562171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.904274] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.904713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.904713] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.904796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.904903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.904998] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1277.945094] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.945380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.945380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.945556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.945708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.956174] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1279.045355] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1279.045743] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.045786] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.046038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.046129] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.548920] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.548920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.576032] env[69238]: INFO networking_nsxv3.common.synchronization [req-a7cebe2e-8ef7-4be8-8a45-b7488e526c0c req-ec188175-7908-446b-b424-d17ddfc22a55 tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_members [ 1279.576032] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_members [ 1279.576032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.576032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.576032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.576032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.576032] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.576032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.576032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.576032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.576032] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.576032] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.967821] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.967821] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.967821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.967821] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.005540] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.005805] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.005975] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.006302] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.006582] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.006794] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.006922] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.007152] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.007305] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.007527] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.007646] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.007772] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.007887] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.008009] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.008125] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.008356] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.028095] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.028389] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1280.028548] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.028727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-895" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.029068] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.029250] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.029375] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.029736] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.029892] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f1d1c4-359c-4fe4-8cc0-ef255f0df466',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.079930] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.080352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.080352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.080493] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.080596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.080833] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.080969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.081050] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.081282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.081380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.081457] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b already deleted. [ 1280.081538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.470942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.471193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.471193] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.471490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.471692] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.471809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.471879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.472077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.472173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.472265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.472418] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.472512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.472571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.472718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.472861] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.472953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.473026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.473169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.473247] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.473332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.473427] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.532768] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.532967] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.533088] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.533376] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.533537] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.533698] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 not found, creating... [ 1280.533968] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.534151] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.534276] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.534496] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.534638] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.534923] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.535102] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.535228] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.535439] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.535580] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.535760] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 is going to be created. [ 1280.556049] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.556269] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.556391] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.556719] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.556892] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.557156] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.975946] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 986357b7-fd8b-4c3b-b87c-f49b9cd2664d: rpc.has_security_group_logging(os_id): False [ 1280.996583] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.996583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.996858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.996858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.996953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.997142] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.997237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.997300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.997448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.997521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.997701] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.997791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.997851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.998018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.998062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.998336] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.998476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.998513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.998632] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.998705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.998790] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1281.057916] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.058720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.058720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.058720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.058720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.074125] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1281.272473] env[69238]: INFO networking_nsxv3.common.synchronization [req-a7cebe2e-8ef7-4be8-8a45-b7488e526c0c req-d97ecbcd-54ec-4375-8a38-3aa42c6855d0 service nova] Enqueued Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_rules [ 1281.272780] env[69238]: INFO networking_nsxv3.common.synchronization [req-a7cebe2e-8ef7-4be8-8a45-b7488e526c0c req-d97ecbcd-54ec-4375-8a38-3aa42c6855d0 service nova] Enqueued Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_members [ 1281.272919] env[69238]: INFO networking_nsxv3.common.synchronization [req-a7cebe2e-8ef7-4be8-8a45-b7488e526c0c req-d97ecbcd-54ec-4375-8a38-3aa42c6855d0 service nova] Enqueued Resource ID: a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 with Priority: HIGHEST for action port [ 1281.273095] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_rules [ 1281.273238] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_members [ 1281.273337] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 with Priority: HIGHEST for action port [ 1281.273905] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.274675] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.274814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.275106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.275194] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.276212] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.276370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.276485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.276655] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.276877] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.277018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.277113] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.277294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.277418] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.277755] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.278499] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.278606] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.279763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.279763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.279763] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f1d1c4-359c-4fe4-8cc0-ef255f0df466',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.781235] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.781396] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.781611] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.782486] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 with status ACTIVE [ 1281.782684] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.782797] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.782872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.783096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.783196] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.783361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.783485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.783662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.783662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.783748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.783910] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.784010] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.784072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.784208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.784281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.784418] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6f1d1c4-359c-4fe4-8cc0-ef255f0df466 is going to be updated. [ 1281.807145] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.807300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.807365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.807568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.807704] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.807867] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6f1d1c4-359c-4fe4-8cc0-ef255f0df466" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.286736] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.789784] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.790047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.790047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.790278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.790444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.790549] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b is going to be created. [ 1282.820735] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.820963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.820963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.821162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.821426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.832455] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b in Status: UNINITIALIZED for 2s [ 1283.091289] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1283.091423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.091537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.091780] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.091832] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.594745] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.595056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.595056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.595226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.595369] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.595473] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.595535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.595685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.595770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.595858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.595948] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.099065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.099065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.099065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.099065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.099065] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.099065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.099065] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.099499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.099499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.099499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.099605] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.099667] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.099720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.099846] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.099982] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.100084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.100146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.100343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.100431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.100512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.100600] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.266522] env[69238]: INFO networking_nsxv3.common.synchronization [req-576389fc-3570-46d5-ae0b-7c08acb5e0e3 req-07ac90c3-cead-4155-a0bf-9650b75f52a6 tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_members [ 1284.266522] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_members [ 1284.266522] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.266689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.266689] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.266948] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.267055] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.267152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.267222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.267352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.267445] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.267555] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.604614] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 986357b7-fd8b-4c3b-b87c-f49b9cd2664d: rpc.has_security_group_logging(os_id): False [ 1284.626613] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.626613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.626613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.626613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.626613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.626613] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.626613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.626613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.626613] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.626957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.626957] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.626957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.627066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.627172] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.627245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.627444] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.627537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.627601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.627734] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.627807] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.627888] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1284.642946] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.643161] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.643290] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.643564] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.643830] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.643993] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.644125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.644338] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.644489] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.644703] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1284.644820] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1284.644935] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1284.645127] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1284.645219] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1284.645334] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1284.645476] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1284.664350] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1284.664555] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1284.664662] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1284.664842] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.665199] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.665376] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.665501] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.665853] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.665990] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.701631] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.701802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.701851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.702082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.702253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.715470] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1284.772109] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.772282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.772321] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.772539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.772661] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.772927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.773141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.773217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.773459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.773593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.773726] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad already deleted. [ 1284.773813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.845489] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b in Status: SUCCESS [ 1284.845800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.846102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.846401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.846658] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.846843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.846916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.847188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.847302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.847441] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.847552] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.168533] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.168824] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.168928] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.169262] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.169423] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.169679] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 not found, creating... [ 1285.169966] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.170146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.170431] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.170746] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.170936] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.171305] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.171493] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.171642] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.171944] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.172136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.172331] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 is going to be created. [ 1285.196091] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.196382] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.196517] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.196829] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.197137] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.197405] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.351582] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.853276] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fca44b0a-2cfa-4faf-be9e-ed1a52fda54b: rpc.has_security_group_logging(os_id): False [ 1285.878026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.878026] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.878026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.878026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b is going to be created. [ 1285.960219] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.960219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.960219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.960219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.960219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.970039] env[69238]: INFO networking_nsxv3.common.synchronization [req-00944918-234e-4957-b64d-4ecd81fe7d1c req-b8b90f42-8123-4bf8-9243-21a7fe39920f tempest-ServerActionsTestOtherB-293023804 tempest-ServerActionsTestOtherB-293023804-project-member] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1285.970039] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGHEST for action security_group_members [ 1285.970927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.971313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.971864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.972124] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.974027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.974027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.974027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.974027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.974027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.974027] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.975466] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b in Status: IN_PROGRESS for 2s [ 1286.290250] env[69238]: INFO networking_nsxv3.common.synchronization [req-576389fc-3570-46d5-ae0b-7c08acb5e0e3 req-69506aa5-b4be-4260-9c94-ebdb1a6c3253 service nova] Enqueued Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_rules [ 1286.290250] env[69238]: INFO networking_nsxv3.common.synchronization [req-576389fc-3570-46d5-ae0b-7c08acb5e0e3 req-69506aa5-b4be-4260-9c94-ebdb1a6c3253 service nova] Enqueued Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_members [ 1286.290250] env[69238]: INFO networking_nsxv3.common.synchronization [req-576389fc-3570-46d5-ae0b-7c08acb5e0e3 req-69506aa5-b4be-4260-9c94-ebdb1a6c3253 service nova] Enqueued Resource ID: 7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 with Priority: HIGHEST for action port [ 1286.294168] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_rules [ 1286.294168] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_members [ 1286.294168] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 with Priority: HIGHEST for action port [ 1286.294168] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.294168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.294168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.294168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.294168] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.295203] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.295593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.295884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.298051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.298051] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.298051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.298051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.298051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.298051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.298051] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.300505] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.300505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.300505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.300505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.300505] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.480508] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.480508] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.480508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.480508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be updated. [ 1286.551957] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.552270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.552494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.552813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.553024] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.571758] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: IN_PROGRESS for 2s [ 1286.730492] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1286.730492] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.802250] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 with status ACTIVE [ 1286.802250] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.802406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.802406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.802736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.802869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.803106] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.803244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.803330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.803525] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.803627] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.803834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.803953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.804066] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.804239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.804361] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.804470] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5 is going to be updated. [ 1286.805603] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.806577] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.806705] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.826392] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.826573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.826654] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.826875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.827055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.827252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c42421a-bb2a-4ed5-ab85-b3d34dd4a9b5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.309348] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.812302] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.812471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.812681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.812850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.812941] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.813115] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad is going to be created. [ 1287.837455] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.837614] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.837686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.837894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.838107] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.850075] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad in Status: UNINITIALIZED for 2s [ 1287.989245] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b in Status: SUCCESS [ 1287.989491] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.583646] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 161eb351-451d-49f3-803f-374b4ae2741c in Status: SUCCESS [ 1288.584094] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 161eb351-451d-49f3-803f-374b4ae2741c deletion is rescheduled due to dependency. [ 1288.584094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.861075] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad in Status: SUCCESS [ 1289.861382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.861517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.861730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.861938] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.862067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.862136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.862486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.862486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.862486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.862819] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.364744] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.868014] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90604fb0-89c6-46f4-9cd4-5a49512e33ad: rpc.has_security_group_logging(os_id): False [ 1290.888073] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.889291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.889291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.889291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.890508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.890508] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.890508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.890508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.890508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.890508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.890508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad is going to be created. [ 1290.950930] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.951125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.951167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.951369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.951679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.962038] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad in Status: IN_PROGRESS for 2s [ 1291.293541] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.293747] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1292.976253] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad in Status: SUCCESS [ 1292.976601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.294464] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.294775] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1297.695545] env[69238]: INFO networking_nsxv3.common.synchronization [req-898120c9-60a6-4e46-bb6b-ef33c53d9f2c req-55a50b86-434f-44a1-b890-1e653534365b tempest-ListServersNegativeTestJSON-871674043 tempest-ListServersNegativeTestJSON-871674043-project-member] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1297.695545] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1297.695545] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.695545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.695545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.695545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.695545] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.695545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.695545] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.698440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.698440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.698440] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.730431] env[69238]: INFO networking_nsxv3.common.synchronization [req-3f4fd72d-5938-434b-a241-83a672946744 req-39b5095c-a31c-432b-a25e-77c9e91a5731 tempest-ListServersNegativeTestJSON-871674043 tempest-ListServersNegativeTestJSON-871674043-project-member] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1297.730431] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGHEST for action security_group_members [ 1297.730431] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.730431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.203122] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.203352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.203429] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.203652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.204804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.204804] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.204804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.204804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.204804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.204804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.204804] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1298.235915] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.236212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.236212] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.236416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.236565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.248143] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1298.449046] env[69238]: INFO networking_nsxv3.common.synchronization [req-7367089c-81c7-4de2-a1f2-e06631f6c2cc req-f82e123f-de02-41eb-90a2-2dfe668fd094 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1298.449801] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1298.450222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.450551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.450551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.450722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.450881] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.450974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.451197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.451197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.451281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.451360] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.954209] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.954501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.954501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.954640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.954728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.954917] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.955023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.955082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.955230] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.955299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.955381] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1298.984264] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.984454] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.984494] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.984664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.984800] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.994676] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1299.274392] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.274605] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.274738] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.275046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.275310] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.275727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.275727] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.275831] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.275946] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.276655] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.276655] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1299.276655] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1299.276655] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1299.276655] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.276932] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1299.276932] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1299.297474] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1299.297743] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1299.297970] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1299.298256] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-41" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.298691] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-27da03d7-51c3-4312-99e6-eebf9771d0c0 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.298953] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.299153] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.299562] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.299777] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27da03d7-51c3-4312-99e6-eebf9771d0c0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.802312] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.802548] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.802682] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.803022] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.803255] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.803422] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 27da03d7-51c3-4312-99e6-eebf9771d0c0 not found, creating... [ 1299.803689] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.803851] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.803974] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.804222] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.804367] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.804651] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.804832] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.804972] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.805508] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.805508] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.805508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 27da03d7-51c3-4312-99e6-eebf9771d0c0 is going to be created. [ 1299.826073] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.826073] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.826274] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.826395] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.826623] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.826869] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.257732] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1300.257995] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d deletion is rescheduled due to dependency. [ 1300.258049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.258219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.258538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.258620] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.258736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.258801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.258954] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.259047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.259195] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.546407] env[69238]: INFO networking_nsxv3.common.synchronization [req-7367089c-81c7-4de2-a1f2-e06631f6c2cc req-bbe54fb9-868c-4e36-ad58-cfc5759ec2c6 service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1300.546407] env[69238]: INFO networking_nsxv3.common.synchronization [req-7367089c-81c7-4de2-a1f2-e06631f6c2cc req-bbe54fb9-868c-4e36-ad58-cfc5759ec2c6 service nova] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1300.546407] env[69238]: INFO networking_nsxv3.common.synchronization [req-7367089c-81c7-4de2-a1f2-e06631f6c2cc req-bbe54fb9-868c-4e36-ad58-cfc5759ec2c6 service nova] Enqueued Resource ID: 27da03d7-51c3-4312-99e6-eebf9771d0c0 with Priority: HIGHEST for action port [ 1300.546407] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_rules [ 1300.546407] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1300.546407] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27da03d7-51c3-4312-99e6-eebf9771d0c0 with Priority: HIGHEST for action port [ 1300.546407] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.546407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.546407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.546407] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.546407] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.547792] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.548322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.548665] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-27da03d7-51c3-4312-99e6-eebf9771d0c0 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.548925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.549091] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.549350] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.549520] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27da03d7-51c3-4312-99e6-eebf9771d0c0',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.764815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.764815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.764815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.764815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.764815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.764815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.764815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.764815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.764815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.765135] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.765135] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be updated. [ 1300.790413] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.790603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.790603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.790831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.790974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.800842] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: IN_PROGRESS for 2s [ 1301.006543] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1301.006735] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1301.006851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.007029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.007234] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.007416] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.007529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.007593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.007739] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.007816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.007905] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.051491] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27da03d7-51c3-4312-99e6-eebf9771d0c0 with status ACTIVE [ 1301.051768] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.051984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.052106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.052351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.052471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.052753] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.052884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.052972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.053186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.053294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.053501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.053639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.053724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.053892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.053994] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.054141] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27da03d7-51c3-4312-99e6-eebf9771d0c0 is going to be updated. [ 1301.055710] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.055837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.076048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.076299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.076299] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.076479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.076625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.076781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27da03d7-51c3-4312-99e6-eebf9771d0c0" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.311026] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.311604] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.311604] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.312069] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.312165] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.312351] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.312481] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.312730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.312905] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.313148] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1301.313342] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1301.313484] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1301.313604] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1301.313727] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1301.313837] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1301.313979] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1301.336256] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1301.336563] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1301.336957] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1301.336957] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.337241] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.337403] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.337528] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.337791] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.338351] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa5c2603-06c4-4cc1-b215-6c3ada0a5445',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.510265] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.840242] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.840501] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.840699] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.841109] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.841292] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.841672] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.841868] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.842015] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.842274] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.842451] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.842829] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.843017] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.843170] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.843681] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.843931] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.844361] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 is going to be updated. [ 1301.869958] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.869958] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.869958] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.870125] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.870283] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.870507] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.012942] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.515593] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.516112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.516112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.516112] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.516332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.516332] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1302.552834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.553070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.553070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.553266] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.553414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.563811] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1302.808188] env[69238]: INFO networking_nsxv3.common.synchronization [req-fe9498f2-61c0-45b1-b285-54daaf8b4870 req-51ce471d-2f5c-4569-8ace-e8c9dcdbf6d1 service nova] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1302.808464] env[69238]: INFO networking_nsxv3.common.synchronization [req-fe9498f2-61c0-45b1-b285-54daaf8b4870 req-51ce471d-2f5c-4569-8ace-e8c9dcdbf6d1 service nova] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1302.808676] env[69238]: INFO networking_nsxv3.common.synchronization [req-fe9498f2-61c0-45b1-b285-54daaf8b4870 req-51ce471d-2f5c-4569-8ace-e8c9dcdbf6d1 service nova] Enqueued Resource ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 with Priority: HIGHEST for action port [ 1302.809553] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_rules [ 1302.809700] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1302.809833] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 with Priority: HIGHEST for action port [ 1302.810234] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.810416] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.810489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.810764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.810870] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.812450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.813232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.813332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.813803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.813803] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.813933] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.814056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.814602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.814602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.814602] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.815558] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.815759] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.815821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.816037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.816141] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa5c2603-06c4-4cc1-b215-6c3ada0a5445',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.818139] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d in Status: SUCCESS [ 1302.818358] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d deletion is rescheduled due to dependency. [ 1302.818484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.318109] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.318282] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.319947] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa5c2603-06c4-4cc1-b215-6c3ada0a5445 with status ACTIVE [ 1303.320177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.320308] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.320388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.320714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.320842] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.321055] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.321164] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.321227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.321442] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.321524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.321725] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.321844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.321909] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.322074] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.322166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.322261] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa5c2603-06c4-4cc1-b215-6c3ada0a5445 is going to be updated. [ 1303.323821] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.347290] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.347495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.347495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.347722] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.347870] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.348043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa5c2603-06c4-4cc1-b215-6c3ada0a5445" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.543862] env[69238]: INFO networking_nsxv3.common.synchronization [req-d8334304-0efa-46a4-a16c-4742bc096ca0 req-f2ab01ef-c202-436f-9317-2e4c9b80afee tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1303.544829] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1303.545237] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.545364] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.545436] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.545625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.545778] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.545918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.545953] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.546084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.546179] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.546271] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.826725] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.048340] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.329310] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.330026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.330026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.330026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.330026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.330026] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 is going to be updated. [ 1304.362482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.362621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.362687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.362913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.363069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.377018] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: IN_PROGRESS for 2s [ 1304.550495] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.575859] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1304.576133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.576369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.576643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.576895] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.577053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.577173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.577374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.577488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.577585] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.577724] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.053245] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.053245] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.053486] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.053520] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.054871] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.054871] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be updated. [ 1305.079829] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.079999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.080084] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.080274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.080492] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.080593] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.080659] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.080822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.080899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.080987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.081149] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.081242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.081287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.081425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.081579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.081673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.081727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.081865] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.081927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.082017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.082108] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.083804] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.083919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.083984] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.084150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.084285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.094221] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 1305.586658] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30b42b8e-961a-4b49-a6b3-231d9a561dc5: rpc.has_security_group_logging(os_id): False [ 1305.604528] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.604698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.604766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.605017] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.605115] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.605319] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.605411] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.605472] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.605621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.605716] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.605916] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.606014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.606095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.606236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.606310] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.606514] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.606607] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.606765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.606911] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.606986] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.607096] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1305.671034] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.671034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.671034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.671034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.671034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.687407] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1306.383406] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: SUCCESS [ 1306.383636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.383815] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.384126] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.384264] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.384362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.384427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.384581] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.384727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.384727] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.384839] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.887925] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.110108] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 1307.110485] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.390346] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16b9fdef-60a6-4350-932c-d208484810e5: rpc.has_security_group_logging(os_id): False [ 1307.415048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.415267] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.415325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.415574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.415683] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.415944] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.416064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.416128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.416314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.416446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.416574] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 is going to be updated. [ 1307.508027] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.508027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.508027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.508027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.508027] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.547757] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: IN_PROGRESS for 2s [ 1307.712048] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1307.712048] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.545489] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.545489] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1309.563327] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: SUCCESS [ 1309.563657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.546103] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.546531] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.547168] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.547489] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.548693] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.549081] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.144534] env[69238]: INFO networking_nsxv3.common.synchronization [req-e939fd12-1d0b-4c8c-887e-fbb9c0a22e59 req-d0766fd5-5688-4ea4-821b-9ab8cd526f69 tempest-ServerActionsTestOtherA-1125676583 tempest-ServerActionsTestOtherA-1125676583-project-member] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1327.145107] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGHEST for action security_group_members [ 1327.145425] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.145576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.145629] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.145804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.145952] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.146062] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.146123] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.146264] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.146363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.146431] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.648470] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.648726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.648726] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.648937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.649047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.649252] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.649343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.649405] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.649560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.649634] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.649732] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be updated. [ 1327.684267] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.684447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.684529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.684698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.684838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.694528] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: IN_PROGRESS for 2s [ 1329.706132] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f87108-657a-479d-b25c-126bec380d7f in Status: SUCCESS [ 1329.706529] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f87108-657a-479d-b25c-126bec380d7f deletion is rescheduled due to dependency. [ 1329.706529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.461506] env[69238]: INFO networking_nsxv3.common.synchronization [req-cdb1631f-56bb-4fc8-a1d2-1d6ec7d53209 req-86720e02-b89f-42d1-8130-9dc475c8c116 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1330.462087] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1330.462417] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.462542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.462608] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.462802] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.463048] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.463134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.463134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.463307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.463362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.464120] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.965542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.965972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.965972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.966058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.966090] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.966287] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.966387] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.966446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.966594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.966672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.966757] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1330.992815] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.993029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.993119] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.993363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.993548] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.003279] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1333.017177] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1333.017467] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 deletion is rescheduled due to dependency. [ 1333.017506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.464555] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.464801] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.466420] env[69238]: INFO networking_nsxv3.common.synchronization [None req-cdd6caa2-ec49-445f-8f21-c108e903a0dc None None] Enqueued Resource ID: f15a3171-fe90-489c-bf88-db985b66b4f8 with Priority: HIGHEST for action port [ 1335.466660] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15a3171-fe90-489c-bf88-db985b66b4f8 with Priority: HIGHEST for action port [ 1335.467568] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-f15a3171-fe90-489c-bf88-db985b66b4f8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.467723] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f15a3171-fe90-489c-bf88-db985b66b4f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.467784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f15a3171-fe90-489c-bf88-db985b66b4f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.468240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f15a3171-fe90-489c-bf88-db985b66b4f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.468340] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15a3171-fe90-489c-bf88-db985b66b4f8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.972075] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f15a3171-fe90-489c-bf88-db985b66b4f8 [ 1335.972536] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.972536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.972536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.972736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.972826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.972934] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f15a3171-fe90-489c-bf88-db985b66b4f8 already deleted. [ 1335.973026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f15a3171-fe90-489c-bf88-db985b66b4f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.606602] env[69238]: INFO networking_nsxv3.common.synchronization [None req-7795cd17-1471-4fbd-8dfb-0717954607e4 None None] Enqueued Resource ID: 33785837-f10d-4b16-ab0d-3654baab1eda with Priority: HIGHEST for action port [ 1337.606909] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33785837-f10d-4b16-ab0d-3654baab1eda with Priority: HIGHEST for action port [ 1337.607235] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-33785837-f10d-4b16-ab0d-3654baab1eda taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.607356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33785837-f10d-4b16-ab0d-3654baab1eda" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.607425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33785837-f10d-4b16-ab0d-3654baab1eda" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.610752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33785837-f10d-4b16-ab0d-3654baab1eda" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.610752] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33785837-f10d-4b16-ab0d-3654baab1eda',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.112657] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33785837-f10d-4b16-ab0d-3654baab1eda [ 1338.112657] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.112837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.112880] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.113117] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.113213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.113312] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33785837-f10d-4b16-ab0d-3654baab1eda already deleted. [ 1338.113390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33785837-f10d-4b16-ab0d-3654baab1eda" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.900797] env[69238]: INFO networking_nsxv3.common.synchronization [req-cd2c4b6d-db32-4b5c-add1-33031801fc25 req-4e590fdc-1c51-42b3-b551-07185835ca47 tempest-DeleteServersTestJSON-2134575 tempest-DeleteServersTestJSON-2134575-project-member] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1339.901352] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGHEST for action security_group_members [ 1339.901746] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.901920] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.902009] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.902218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.902384] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.903355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.903355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.903355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.903355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.903355] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.165601] env[69238]: INFO networking_nsxv3.common.synchronization [req-93db2e5f-e89f-4d0a-98e1-9b26fce22d58 req-31804e02-dcb3-4d3d-8814-adaa15761885 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1340.166162] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1340.166562] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.166804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.166902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.167131] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.167291] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.167388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.167449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.167598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.167702] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.167802] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.406350] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.406497] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.406599] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.406872] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.406971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.407279] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.407379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.407459] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.407668] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.407750] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.407860] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be updated. [ 1340.429394] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.429675] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.429882] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.430239] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.430587] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.430882] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.431096] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.431388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.431616] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.432028] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1340.432205] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1340.432399] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1340.432636] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1340.432736] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1340.432938] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1340.433163] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1340.436751] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.436877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.436961] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.437160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.437300] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.450049] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: IN_PROGRESS for 2s [ 1340.461582] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1340.461758] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1340.462024] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1340.462261] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.462624] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.462848] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.463120] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.463404] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.463578] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.670092] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.670332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.670432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.670738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.670840] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.671059] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.671160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.671223] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.671380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.671457] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.671546] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1340.697200] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.697401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.697401] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.697621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.697762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.707393] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1340.965974] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.965974] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.965974] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.966427] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.966427] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.966596] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 not found, creating... [ 1340.966861] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.967040] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.967171] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.967379] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.967522] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.967813] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.967975] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.968115] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.968323] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.968461] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.968677] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 is going to be created. [ 1340.989694] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.989904] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.990044] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.990350] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.990586] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.990949] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.796291] env[69238]: INFO networking_nsxv3.common.synchronization [req-93db2e5f-e89f-4d0a-98e1-9b26fce22d58 req-2981646e-8a65-45ff-b6f0-7fe37809ed70 service nova] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 1341.796485] env[69238]: INFO networking_nsxv3.common.synchronization [req-93db2e5f-e89f-4d0a-98e1-9b26fce22d58 req-2981646e-8a65-45ff-b6f0-7fe37809ed70 service nova] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1341.796630] env[69238]: INFO networking_nsxv3.common.synchronization [req-93db2e5f-e89f-4d0a-98e1-9b26fce22d58 req-2981646e-8a65-45ff-b6f0-7fe37809ed70 service nova] Enqueued Resource ID: ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 with Priority: HIGHEST for action port [ 1341.796860] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 1341.796989] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1341.797104] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 with Priority: HIGHEST for action port [ 1341.797648] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.798026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.798026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.798227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.798227] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.801342] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.801342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.801342] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.801342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.801342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.801342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.801342] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.913045] env[69238]: INFO networking_nsxv3.common.synchronization [req-70d623e6-fbb3-45bf-9e63-c4e42100e6c9 req-ed3a3f0d-b16f-4d06-8777-646de39782f6 tempest-ServerRescueTestJSON-262352516 tempest-ServerRescueTestJSON-262352516-project-member] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1341.913600] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1341.913900] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.914028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.914098] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.914343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.914497] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.914592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.914665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.914818] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.914901] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.914992] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.302116] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.302116] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.306129] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 with status ACTIVE [ 1342.306129] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.306129] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.306129] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.306129] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.308362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.308362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.308362] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5 is going to be updated. [ 1342.313332] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.313565] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.313702] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.314031] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.314309] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.314492] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.314629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.314854] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.315041] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.315276] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.315402] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.315560] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.315684] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.315804] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.315915] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.316065] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.336306] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.336538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.336538] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.336714] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.336850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.337030] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebcdb3b0-f9b2-4b13-887e-a6b07ce90ab5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.338007] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.338197] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1342.338344] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.338513] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.338802] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-d702b25f-723a-44cd-8069-f02117ffcf04 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.338970] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.339136] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.339437] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.339583] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d702b25f-723a-44cd-8069-f02117ffcf04',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.416984] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.417211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.417273] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.417473] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.417565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.417761] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.417860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.417923] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.418085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.418162] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.418260] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 already deleted. [ 1342.418356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.460636] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 in Status: SUCCESS [ 1342.460868] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 deletion is rescheduled due to dependency. [ 1342.460935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.717082] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1342.717286] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 deletion is rescheduled due to dependency. [ 1342.717399] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.717560] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.718177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.718177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.718177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.718177] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.718488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.718488] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.718488] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.842216] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.842447] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.842581] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.842886] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.843076] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.843240] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port d702b25f-723a-44cd-8069-f02117ffcf04 not found, creating... [ 1342.843517] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.843684] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.843809] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.844140] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.844293] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.844594] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.844760] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.844887] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.845133] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.845275] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.845418] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: d702b25f-723a-44cd-8069-f02117ffcf04 is going to be created. [ 1342.865345] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.865577] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.865681] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.865981] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.866238] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.866476] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.220916] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.532446] env[69238]: INFO networking_nsxv3.common.synchronization [req-70d623e6-fbb3-45bf-9e63-c4e42100e6c9 req-a3ef5d4c-19eb-44de-8de6-dd3a4ad0e284 service nova] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_rules [ 1343.532739] env[69238]: INFO networking_nsxv3.common.synchronization [req-70d623e6-fbb3-45bf-9e63-c4e42100e6c9 req-a3ef5d4c-19eb-44de-8de6-dd3a4ad0e284 service nova] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1343.532847] env[69238]: INFO networking_nsxv3.common.synchronization [req-70d623e6-fbb3-45bf-9e63-c4e42100e6c9 req-a3ef5d4c-19eb-44de-8de6-dd3a4ad0e284 service nova] Enqueued Resource ID: d702b25f-723a-44cd-8069-f02117ffcf04 with Priority: HIGHEST for action port [ 1343.533019] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_rules [ 1343.533142] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1343.533240] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d702b25f-723a-44cd-8069-f02117ffcf04 with Priority: HIGHEST for action port [ 1343.533795] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.533915] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.533982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.534244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.534325] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.535415] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.535534] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.535622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.535778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.535962] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.536077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.536141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.536285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.536368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.536468] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.537243] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-d702b25f-723a-44cd-8069-f02117ffcf04 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.537379] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.537463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.537639] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.537720] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d702b25f-723a-44cd-8069-f02117ffcf04',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.722636] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.039925] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.039925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.040437] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.041096] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d702b25f-723a-44cd-8069-f02117ffcf04 with status ACTIVE [ 1344.041280] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.041390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.041456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.041656] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.042051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.042051] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.042051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.042051] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.042242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.042279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.042450] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.042541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.042601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.042736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.042811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.042915] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d702b25f-723a-44cd-8069-f02117ffcf04 is going to be updated. [ 1344.066128] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.066278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.066406] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.066568] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.066724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.066899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d702b25f-723a-44cd-8069-f02117ffcf04" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.224735] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.224886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.224979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.225205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.225305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.225404] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1344.255756] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.256054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.256054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.256187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.256339] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.265838] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1344.545133] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.048008] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.048197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.048271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.048522] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.048621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.048725] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 is going to be created. [ 1345.073193] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.073347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.073347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.073506] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.073664] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.082714] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: UNINITIALIZED for 2s [ 1346.275266] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1346.275598] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.275791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.276068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.276297] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.276563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.276563] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.276674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.276707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.276792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.276882] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.779293] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.092455] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: SUCCESS [ 1347.092803] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.092845] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.093072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.093270] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.094120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.094120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.094120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.094120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.094120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.094120] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.282729] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66936bcb-aef7-4123-ae9d-1753abcc41e7: rpc.has_security_group_logging(os_id): False [ 1347.305656] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.305879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.305879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.306102] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.306201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.306461] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.306562] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.306636] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.306792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.306902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.306941] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1347.365927] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.366163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.366163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.366356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.366504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.378268] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1347.596600] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.596899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.596899] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.597111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.597284] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.597412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.597482] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.597591] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.597673] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.597763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.598021] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.598133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.598201] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.598343] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.598484] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.598575] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.598640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.598761] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.598848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.598910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.598995] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.102156] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37845621-95b4-4be5-a9ca-9ac2f7931757: rpc.has_security_group_logging(os_id): False [ 1348.118729] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.118925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.118925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.119170] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.119259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.119473] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.119573] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.119635] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.119781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.119857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.120058] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.120152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.120211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.120345] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.120415] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.120591] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.120724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.120793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.120905] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.120976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.121071] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 is going to be created. [ 1348.181662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.181927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.181927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.182134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.182318] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.192982] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: IN_PROGRESS for 2s [ 1348.534952] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.535295] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1349.392766] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1349.392766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.598154] env[69238]: INFO networking_nsxv3.common.synchronization [req-e86dcaad-bdb0-45d3-a502-125576dfb8d2 req-b1387f26-e20f-4e5c-a7e3-87f4fdf325ed tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_members [ 1349.598728] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGHEST for action security_group_members [ 1349.599129] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.599283] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.599355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.599566] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.599725] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.599821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.599886] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.600061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.600150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.600244] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.103304] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.103543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.103543] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.103756] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.104052] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.104281] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.104384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.104440] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.104605] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.104678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.104764] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad is going to be updated. [ 1350.132313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.132313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.132313] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.132586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.132586] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.143838] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad in Status: IN_PROGRESS for 2s [ 1350.208804] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: SUCCESS [ 1350.208976] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.512070] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1351.512486] env[69238]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-848500ce-80e7-428f-95dc-0cd9f83c2ac6 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1352.154986] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad in Status: SUCCESS [ 1352.155166] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad deletion is rescheduled due to dependency. [ 1352.155249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.178687] env[69238]: INFO networking_nsxv3.common.synchronization [req-4fd44702-07e0-4348-8aea-8d5deaa59e1a req-33d4e59d-bd41-4108-b81e-50d7504d8fa3 tempest-AttachVolumeTestJSON-574272729 tempest-AttachVolumeTestJSON-574272729-project-member] Enqueued Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_members [ 1352.179193] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGHEST for action security_group_members [ 1352.179455] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.179578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.179644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.179843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.179997] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.180191] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.180285] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.180477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.180594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.180709] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.685715] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.686160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.686160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.686344] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.686444] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.686643] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.686749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.686816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.686963] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.687059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.687143] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b is going to be updated. [ 1352.717866] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.718071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.718148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.718291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.718430] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.728032] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b in Status: IN_PROGRESS for 2s [ 1354.268882] env[69238]: INFO networking_nsxv3.common.synchronization [None req-ca56ea21-f8ed-4356-a756-a19e817f06ab tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_rules [ 1354.269444] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_rules [ 1354.269747] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.269869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.269935] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.270199] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.270283] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.339278] env[69238]: INFO networking_nsxv3.common.synchronization [None req-1987a462-4737-4900-a889-777ec12c8d48 tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_rules [ 1354.340036] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_rules [ 1354.340400] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.340504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.738843] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b in Status: SUCCESS [ 1354.739035] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b deletion is rescheduled due to dependency. [ 1354.739169] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.789571] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.789728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.789805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.790059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.790128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.790222] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 already deleted. [ 1354.790304] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.790446] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.790596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.790676] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.314177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.314521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.314521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.314592] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.314720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.314774] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 already deleted. [ 1355.314843] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.340848] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.341247] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.784777] env[69238]: INFO networking_nsxv3.common.synchronization [req-2d3d6e92-1667-4558-ab11-c40d2949d51c req-4c848fe0-dcd3-4c5e-8ea5-08a4f60335e1 tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_members [ 1359.785317] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_members [ 1359.786049] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8a8e5f-f562-4849-9d65-5e443e2e8719 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.786250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.786362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.786701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.786918] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.787077] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.787183] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.787384] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.787518] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.787675] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.164030] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.164304] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.164534] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.164924] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.165318] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.165634] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.165736] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.166018] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.166184] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.166402] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.166523] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1360.166636] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1360.166748] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1360.166861] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.167080] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1360.167266] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1360.191105] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1360.191260] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1360.191408] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1360.191599] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-428" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.192232] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.192370] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.192414] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.192726] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.192873] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.289825] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.289987] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.290058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.290276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.290369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.290562] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.290662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.290741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.290991] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.291055] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.291142] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 already deleted. [ 1360.291224] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.695040] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.695419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.695419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.695666] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.695831] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.695992] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 not found, creating... [ 1360.696287] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.696464] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.696586] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.696812] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.697033] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.697270] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.697433] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.697551] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.697764] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.697913] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.698078] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 is going to be created. [ 1360.718138] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.718365] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.718457] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.718707] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.718939] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.719191] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.446286] env[69238]: INFO networking_nsxv3.common.synchronization [req-2d3d6e92-1667-4558-ab11-c40d2949d51c req-1fb9d717-f5e9-4e53-a4fd-88251ca5ed82 service nova] Enqueued Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_rules [ 1361.446476] env[69238]: INFO networking_nsxv3.common.synchronization [req-2d3d6e92-1667-4558-ab11-c40d2949d51c req-1fb9d717-f5e9-4e53-a4fd-88251ca5ed82 service nova] Enqueued Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_members [ 1361.446632] env[69238]: INFO networking_nsxv3.common.synchronization [req-2d3d6e92-1667-4558-ab11-c40d2949d51c req-1fb9d717-f5e9-4e53-a4fd-88251ca5ed82 service nova] Enqueued Resource ID: 6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 with Priority: HIGHEST for action port [ 1361.446943] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_rules [ 1361.447033] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_members [ 1361.447123] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 with Priority: HIGHEST for action port [ 1361.447697] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.447823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.447892] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.448272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.448360] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.449355] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8a8e5f-f562-4849-9d65-5e443e2e8719 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.449537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.449619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.449809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.449959] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.450075] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.450136] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.450272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.450356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.450446] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.455372] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.455372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.455372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.455372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.455372] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.817337] env[69238]: INFO networking_nsxv3.common.synchronization [req-2b50e628-837a-40ae-9812-32b4517f5e94 req-9b695261-e5fb-46fd-b562-04c37f27ab5b tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1361.817886] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16b9fdef-60a6-4350-932c-d208484810e5 with Priority: HIGHEST for action security_group_members [ 1361.818235] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-16b9fdef-60a6-4350-932c-d208484810e5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.818359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.818424] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.818809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.818977] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.819096] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.819160] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.819325] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.819431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.819772] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16b9fdef-60a6-4350-932c-d208484810e5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.953645] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.957020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8a8e5f-f562-4849-9d65-5e443e2e8719 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.957020] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 with status ACTIVE [ 1361.957020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.957020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.957020] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.957020] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.957809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.957809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.957809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.957809] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.957809] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8 is going to be updated. [ 1361.979328] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.979644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.979644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.979766] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.979861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.980138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bfa2da9-c6c2-47ac-bcac-0bb32aa980f8" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.322119] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.322353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.322353] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.322551] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.322643] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.322830] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.322929] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.322988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.323151] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.323228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.323311] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 is going to be updated. [ 1362.353682] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.353879] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.353930] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.354145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.354296] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.362635] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: IN_PROGRESS for 2s [ 1362.458184] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.966695] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.967053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.967053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.968016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.968016] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.968016] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 is going to be created. [ 1362.997502] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.997502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.997762] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.998232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.998232] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.010448] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 in Status: UNINITIALIZED for 2s [ 1364.372501] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16b9fdef-60a6-4350-932c-d208484810e5 in Status: SUCCESS [ 1364.372894] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16b9fdef-60a6-4350-932c-d208484810e5 deletion is rescheduled due to dependency. [ 1364.372894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16b9fdef-60a6-4350-932c-d208484810e5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.852631] env[69238]: INFO networking_nsxv3.common.synchronization [req-970ec8c1-a00b-4a5e-afee-7faea9074f97 req-ad2e28dd-c517-4fc7-b435-d36751843728 tempest-ServerRescueTestJSON-262352516 tempest-ServerRescueTestJSON-262352516-project-member] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1364.853033] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1364.853258] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.853346] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.853382] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.853574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.853727] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.853826] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.853884] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.854292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.854292] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.854292] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.019632] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 in Status: SUCCESS [ 1365.019869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.020138] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.020287] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.020463] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.020582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.020644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.020812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.020921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.021021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.021109] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.150133] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.150373] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.150505] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.150798] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.151146] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.151317] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.151444] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.151668] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.151848] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.152119] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1365.152245] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1365.152372] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1365.152486] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1365.152614] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1365.152744] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1365.152877] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1365.170092] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1365.170255] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1365.170402] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1365.170582] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-52" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.170918] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.171114] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.171241] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.171559] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.171701] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ef2110-358d-47ac-be9e-7f7258bf0bd2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.357135] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.523512] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.674978] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.674978] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.674978] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.675303] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.675303] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.675550] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port c6ef2110-358d-47ac-be9e-7f7258bf0bd2 not found, creating... [ 1365.675869] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.676086] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.676244] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.676510] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.676691] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.677014] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.677245] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.677376] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.677587] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.677725] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.677926] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: c6ef2110-358d-47ac-be9e-7f7258bf0bd2 is going to be created. [ 1365.699973] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.699973] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.700315] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.700472] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.700712] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.701046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.859332] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.026301] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc8a8e5f-f562-4849-9d65-5e443e2e8719: rpc.has_security_group_logging(os_id): False [ 1366.046625] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.046868] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.047049] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.047334] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.047426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.047675] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.047774] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.047839] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.047999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.048094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.048180] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 is going to be created. [ 1366.112542] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.112811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.112960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.113176] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.113367] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.126799] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 in Status: IN_PROGRESS for 2s [ 1366.361738] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.361919] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.361995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.362262] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.362354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.362471] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 is going to be updated. [ 1366.398702] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.398906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.398906] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.399166] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.399340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.408205] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: IN_PROGRESS for 2s [ 1366.550108] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0e38686a-475b-4941-89a0-76c2c9af05af tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1366.550629] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1366.550990] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.551122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.551188] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.551433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.551513] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.628792] env[69238]: INFO networking_nsxv3.common.synchronization [None req-0e4b6569-55e9-4927-bd56-13a2dbce00f4 tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1366.629415] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1366.629714] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.629819] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.696751] env[69238]: INFO networking_nsxv3.common.synchronization [req-970ec8c1-a00b-4a5e-afee-7faea9074f97 req-ce59d7b6-7117-48b8-84eb-122836d2d4fb service nova] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_rules [ 1366.697072] env[69238]: INFO networking_nsxv3.common.synchronization [req-970ec8c1-a00b-4a5e-afee-7faea9074f97 req-ce59d7b6-7117-48b8-84eb-122836d2d4fb service nova] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1366.697253] env[69238]: INFO networking_nsxv3.common.synchronization [req-970ec8c1-a00b-4a5e-afee-7faea9074f97 req-ce59d7b6-7117-48b8-84eb-122836d2d4fb service nova] Enqueued Resource ID: c6ef2110-358d-47ac-be9e-7f7258bf0bd2 with Priority: HIGHEST for action port [ 1366.697966] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_rules [ 1366.698167] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1366.698285] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ef2110-358d-47ac-be9e-7f7258bf0bd2 with Priority: HIGHEST for action port [ 1366.698610] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.698748] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.698811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.699111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.699319] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.700173] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.700173] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.700388] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.700490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.700577] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.700860] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.700933] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ef2110-358d-47ac-be9e-7f7258bf0bd2',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.085219] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.085219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.085219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.085219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.085219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.085219] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 already deleted. [ 1367.085219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.085219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.085219] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.085219] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.202415] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.202590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.202928] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6ef2110-358d-47ac-be9e-7f7258bf0bd2 with status ACTIVE [ 1367.202928] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.203132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.203132] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.203431] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.203501] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.203745] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.203898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.204195] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.204281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.204381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.204646] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.204787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.204878] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.209256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.209403] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.209477] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6ef2110-358d-47ac-be9e-7f7258bf0bd2 is going to be updated. [ 1367.241140] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.241370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.241370] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.241647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.241767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.241921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6ef2110-358d-47ac-be9e-7f7258bf0bd2" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.610066] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.610511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.610511] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.610645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.610645] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.610743] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 already deleted. [ 1367.610824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.140088] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 in Status: SUCCESS [ 1368.140088] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.418355] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: SUCCESS [ 1368.418576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.418789] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.419094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.419340] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.419515] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.419623] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.419841] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.419980] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.420194] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.922523] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.425326] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.927986] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.928302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.928302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.928484] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.928565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.928664] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 is going to be updated. [ 1369.957928] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.958137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.958137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.958394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.958540] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.968406] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: IN_PROGRESS for 2s [ 1371.699543] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.699938] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1371.979018] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: SUCCESS [ 1371.979276] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.979449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.979665] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.979855] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.979971] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.980057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.980209] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.980290] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.980376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.980461] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.048877] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ee23e5b-85f3-4cc0-b31e-2db271256483 req-42c6a418-3f07-46be-bc09-c41531e76200 tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1372.049648] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1372.049721] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.049787] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.049837] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.050174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.050385] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.050490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.050572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.050755] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.050850] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.050976] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.303816] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.304071] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.304232] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.304682] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.304877] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.305067] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.305197] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.305470] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.305683] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.305963] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1372.306100] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1372.306235] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1372.306375] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1372.306518] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1372.306653] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1372.306822] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1372.326902] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1372.327202] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1372.327285] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1372.327406] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.327729] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-66f32aac-6fec-42cb-9982-cb51ca8e2c08 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.327909] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.328046] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.328382] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.328530] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f32aac-6fec-42cb-9982-cb51ca8e2c08',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.482791] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.483039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.483039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.483249] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.483417] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.483521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.483584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.483732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.483822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.483910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.484069] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.484161] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.484220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.484391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.484531] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.484621] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.484681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.484822] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.484913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.484997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.485099] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.553754] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.553972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.553972] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.554150] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.554242] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.554438] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.554541] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.554603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.554757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.554833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.554915] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 already deleted. [ 1372.554996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.834164] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.834164] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 66f32aac-6fec-42cb-9982-cb51ca8e2c08 not found, creating... [ 1372.834164] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.834164] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.835873] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.835873] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.835873] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.835873] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.835873] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.835873] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 is going to be created. [ 1372.856901] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.857258] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.857566] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.857866] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.858138] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.858413] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.987247] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37845621-95b4-4be5-a9ca-9ac2f7931757: rpc.has_security_group_logging(os_id): False [ 1373.007538] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.007814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.007814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.007969] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.008070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.008294] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.008390] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.008449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.008602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.008678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.008861] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.008979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.009054] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.009197] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.009271] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.009446] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.009530] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.009594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.009724] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.009794] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.009876] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 is going to be updated. [ 1373.090566] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.090779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.090779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.091008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.091178] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.106278] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: IN_PROGRESS for 2s [ 1373.567902] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ee23e5b-85f3-4cc0-b31e-2db271256483 req-91bfe400-afd2-42d5-8599-78ef93ed0874 service nova] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1373.568130] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ee23e5b-85f3-4cc0-b31e-2db271256483 req-91bfe400-afd2-42d5-8599-78ef93ed0874 service nova] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1373.568279] env[69238]: INFO networking_nsxv3.common.synchronization [req-9ee23e5b-85f3-4cc0-b31e-2db271256483 req-91bfe400-afd2-42d5-8599-78ef93ed0874 service nova] Enqueued Resource ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 with Priority: HIGHEST for action port [ 1373.568818] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1373.569076] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1373.569076] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 with Priority: HIGHEST for action port [ 1373.569345] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.569463] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.569539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.569779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.569861] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.570659] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.570770] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.570834] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.571021] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.571187] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.571274] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.571328] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.571439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.571521] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.571603] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.572347] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-66f32aac-6fec-42cb-9982-cb51ca8e2c08 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.572451] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.572517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.572782] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.572782] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f32aac-6fec-42cb-9982-cb51ca8e2c08',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.074522] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.075604] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.075744] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.077204] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66f32aac-6fec-42cb-9982-cb51ca8e2c08 with status ACTIVE [ 1374.077366] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.077477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.077537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.077731] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.077863] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.078073] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.078073] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.078159] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.078278] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.078347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.078520] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.078804] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.078960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.079111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.079187] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.079288] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 is going to be updated. [ 1374.100785] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.101056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.101056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.101239] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.101374] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.101529] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.577276] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.079581] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.079927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.079927] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.080018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.080118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.080168] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 is going to be created. [ 1375.103042] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.103042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.103042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.103315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.103351] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.117119] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: UNINITIALIZED for 2s [ 1375.121360] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: SUCCESS [ 1375.121612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.132097] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: SUCCESS [ 1377.132414] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.132535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.132752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.132949] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.133082] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.133250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.133289] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.133369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.133453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.133543] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.636132] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.138906] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1: rpc.has_security_group_logging(os_id): False [ 1378.158933] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.159137] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.159236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.159619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.159701] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.159939] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.160086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.160174] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.160372] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.160478] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.160639] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 is going to be created. [ 1378.218866] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.219064] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.219139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.219363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.219539] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.242599] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: IN_PROGRESS for 2s [ 1378.570784] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.570784] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1380.257794] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: SUCCESS [ 1380.258128] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.444404] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.444404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.444813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.444913] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.445157] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.947849] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.451361] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.953517] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1382.953808] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1383.571331] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.571658] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.765031] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.765031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.765031] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.765358] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.777867] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1383.778898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.779948] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1383.820829] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.821185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.821185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.821423] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.840550] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.841492] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1383.841653] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1383.841653] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1383.890805] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.891093] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.891270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.891502] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.893194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.893472] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1383.995825] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.995825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.995825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.995825] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.996134] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.996166] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1384.091128] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.091385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.091385] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.091557] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.091869] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.092248] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1384.092352] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'701311bc-7e63-4b43-8b04-eb0d3bca2b85', 'd3f87108-657a-479d-b25c-126bec380d7f', '46081765-9c91-4ec4-ae2a-1a302b9161d1', 'adcaa282-9bd0-4318-8903-fc1e657e143d', '66936bcb-aef7-4123-ae9d-1753abcc41e7', '161eb351-451d-49f3-803f-374b4ae2741c', 'd2cd8869-5f9f-4177-a677-855677a36a05', '1ab364ad-4952-4848-9774-a09b5ae9ee0e', '30b42b8e-961a-4b49-a6b3-231d9a561dc5', '986357b7-fd8b-4c3b-b87c-f49b9cd2664d', 'c767742c-a318-4de7-875d-b9006231b601', '90604fb0-89c6-46f4-9cd4-5a49512e33ad', '307a84b6-ec60-4d35-ac8b-3997b74cc597', '8fc812c2-d9bf-4340-ac39-bbb8659329cc', 'fca44b0a-2cfa-4faf-be9e-ed1a52fda54b', 'd15632cf-7f81-4a48-a43d-b6ab97d126e9', '9289966e-1f55-477f-8d5c-d3d5fe95527c', 'd4f8c658-0121-4451-aadb-f2f4c356e1b7', 'e6984856-6c1b-4d02-a5b7-08f98ac851be', 'af5e1a5e-9272-4c94-94cf-f661ba1cc217', '78f92256-b4da-4815-aefb-cda5bc01bc11', '1e00b7de-bd62-4244-a65e-9ce263afed97', 'dc8a8e5f-f562-4849-9d65-5e443e2e8719', 'e3efc2ce-5009-447c-a310-4d3178a7395c', '69fbfff4-4d12-49da-9085-7d562819c005', 'aee600fe-2d5e-4376-8f72-81cf57665aed', '152bfed9-95f9-4ec2-aa19-b1e2ea0a9ee6', 'fc8f1ded-72b4-4b3d-86f9-3cc1338a788e', '9a29c175-5acc-4d5c-b7f6-b89ab43280ee', '4b1eab02-6277-4c21-b07d-5b4f5b13a3f2', 'c9df4a22-2e58-46f6-9dc8-bffb28401a54', 'b90b4f01-4981-48aa-a11f-0269ff567c26', 'f19e634f-6fff-469e-93a7-10ba29d4b8a8', '25038b26-9f62-4166-947d-1ed4704a05a1', '16b9fdef-60a6-4350-932c-d208484810e5', 'b6b0ebb8-e601-44fa-aac4-0c8f25377737', 'ba7e2a36-c9c9-4215-a1d8-e7ad06fe75bd', '1190c58c-c48e-453c-afe1-9063beda849a', 'c10bb76f-7801-4c7d-b6c4-3f418c87d789', '1cd8a4c5-7d49-440a-bef6-697272c0d01d', 'aa4bf1f1-444a-46b5-b4a0-baa2f52159cc', '5d9b6b76-7856-4e7e-a2a3-3e1756e445ad', '7fc20ddc-91f2-4ada-b5e2-712c907ad8c6', 'fa7aa785-c4cc-4dae-b206-8934232efdf2', 'a6bd121c-8d73-451b-96a4-3bfa5fbaad57', 'a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1', '9501cdef-a5a1-4d58-9c4f-32f41304e816', '37845621-95b4-4be5-a9ca-9ac2f7931757', 'ef1fbd20-ebb9-4452-9997-2dd3dbbcd1fe', '5a436812-7ebf-4b10-8e25-2625390204e8'} {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1384.092508] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1384.111765] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.111960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.111960] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.112213] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.112305] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.112413] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1384.112485] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1384.112555] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1384.196587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.196861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.196861] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.197072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.198314] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.198616] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1384.198713] env[69238]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69238) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1384.198792] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1384.198858] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1384.199149] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1384.199260] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGH for action security_group_rules [ 1384.199348] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGH for action security_group_rules [ 1384.199422] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGH for action security_group_rules [ 1384.199486] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGH for action security_group_rules [ 1384.199565] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGH for action security_group_rules [ 1384.199668] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGH for action security_group_rules [ 1384.199736] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGH for action security_group_rules [ 1384.199795] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGH for action security_group_rules [ 1384.199888] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGH for action security_group_rules [ 1384.199996] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGH for action security_group_rules [ 1384.199996] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGH for action security_group_rules [ 1384.200203] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGH for action security_group_rules [ 1384.200203] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGH for action security_group_rules [ 1384.200309] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGH for action security_group_rules [ 1384.200309] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGH for action security_group_rules [ 1384.200418] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGH for action security_group_rules [ 1384.200418] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGH for action security_group_rules [ 1384.200544] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGH for action security_group_rules [ 1384.200544] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGH for action security_group_rules [ 1384.200667] env[69238]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGH for action security_group_rules [ 1384.200718] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.573138] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.573483] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1388.573483] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 with Priority: HIGH for action security_group_rules [ 1388.573554] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 with Priority: HIGH for action security_group_rules [ 1388.573641] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2cd8869-5f9f-4177-a677-855677a36a05 with Priority: HIGH for action security_group_rules [ 1388.573740] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b with Priority: HIGH for action security_group_rules [ 1388.573898] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 with Priority: HIGH for action security_group_rules [ 1388.574012] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6984856-6c1b-4d02-a5b7-08f98ac851be with Priority: HIGH for action security_group_rules [ 1388.574114] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 with Priority: HIGH for action security_group_rules [ 1388.574208] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c with Priority: HIGH for action security_group_rules [ 1388.574299] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc with Priority: HIGH for action security_group_rules [ 1388.574387] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 with Priority: HIGH for action security_group_rules [ 1388.574477] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 with Priority: HIGH for action security_group_rules [ 1388.574564] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad with Priority: HIGH for action security_group_rules [ 1388.574651] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c767742c-a318-4de7-875d-b9006231b601 with Priority: HIGH for action security_group_rules [ 1388.574735] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d with Priority: HIGH for action security_group_rules [ 1388.574821] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 with Priority: HIGH for action security_group_rules [ 1388.574906] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 161eb351-451d-49f3-803f-374b4ae2741c with Priority: HIGH for action security_group_rules [ 1388.574987] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e with Priority: HIGH for action security_group_rules [ 1388.575078] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGH for action security_group_rules [ 1388.575197] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f87108-657a-479d-b25c-126bec380d7f with Priority: HIGH for action security_group_rules [ 1388.575250] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcaa282-9bd0-4318-8903-fc1e657e143d with Priority: HIGH for action security_group_rules [ 1388.575590] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.575720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.575788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.575982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.576073] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701311bc-7e63-4b43-8b04-eb0d3bca2b85',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.577039] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46081765-9c91-4ec4-ae2a-1a302b9161d1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.577167] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.577258] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.577447] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.577522] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46081765-9c91-4ec4-ae2a-1a302b9161d1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.578520] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2cd8869-5f9f-4177-a677-855677a36a05 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.578688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.578688] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.578827] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.578900] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2cd8869-5f9f-4177-a677-855677a36a05',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.579579] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.579684] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.579758] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.579951] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.580037] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fca44b0a-2cfa-4faf-be9e-ed1a52fda54b',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.580709] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.581144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.581144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.581144] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.581290] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af5e1a5e-9272-4c94-94cf-f661ba1cc217',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.581834] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6984856-6c1b-4d02-a5b7-08f98ac851be taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.581932] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.581995] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.582186] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.582259] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6984856-6c1b-4d02-a5b7-08f98ac851be',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.583034] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.583139] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.583222] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.583352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.583433] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4f8c658-0121-4451-aadb-f2f4c356e1b7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.584105] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9289966e-1f55-477f-8d5c-d3d5fe95527c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.584211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.584270] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.584425] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.584489] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9289966e-1f55-477f-8d5c-d3d5fe95527c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.585189] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.585298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.585347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.585537] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.585593] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc812c2-d9bf-4340-ac39-bbb8659329cc',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.586283] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.586394] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.586456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.586612] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.586671] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d15632cf-7f81-4a48-a43d-b6ab97d126e9',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.587517] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-307a84b6-ec60-4d35-ac8b-3997b74cc597 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.587624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.587682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.587847] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.587912] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('307a84b6-ec60-4d35-ac8b-3997b74cc597',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.588583] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.588687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.588749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.588902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.588962] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90604fb0-89c6-46f4-9cd4-5a49512e33ad',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.589716] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c767742c-a318-4de7-875d-b9006231b601 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.589823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.590071] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.590248] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.590321] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c767742c-a318-4de7-875d-b9006231b601',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.591161] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.591265] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.591332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.591554] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.591554] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('986357b7-fd8b-4c3b-b87c-f49b9cd2664d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.592266] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.592365] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.592527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.592571] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.592630] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30b42b8e-961a-4b49-a6b3-231d9a561dc5',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.593309] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-161eb351-451d-49f3-803f-374b4ae2741c taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.593437] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.593528] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.593647] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.593719] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('161eb351-451d-49f3-803f-374b4ae2741c',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.594384] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.594584] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.594641] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.594784] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.594856] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab364ad-4952-4848-9774-a09b5ae9ee0e',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.595662] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.595764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.595764] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.595917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.595987] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.596652] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f87108-657a-479d-b25c-126bec380d7f taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.596749] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.596814] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.596958] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.597043] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f87108-657a-479d-b25c-126bec380d7f',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.597688] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adcaa282-9bd0-4318-8903-fc1e657e143d taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.597791] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.597856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.597996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.598080] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adcaa282-9bd0-4318-8903-fc1e657e143d',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.623112] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.623359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.623359] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.623527] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.626671] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.626811] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.627474] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.627583] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.646979] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.647131] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46081765-9c91-4ec4-ae2a-1a302b9161d1 is going to be deleted. [ 1388.647937] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.648155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.668072] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.668236] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701311bc-7e63-4b43-8b04-eb0d3bca2b85 is going to be deleted. [ 1388.669141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.669357] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.688582] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.688737] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2cd8869-5f9f-4177-a677-855677a36a05 is going to be deleted. [ 1388.707383] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.707596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.707596] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.707816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.707910] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.708043] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46081765-9c91-4ec4-ae2a-1a302b9161d1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.718028] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.718028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.718028] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.718259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.718259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.718330] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701311bc-7e63-4b43-8b04-eb0d3bca2b85" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.733161] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.733388] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.733503] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.733824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.733993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.734252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2cd8869-5f9f-4177-a677-855677a36a05" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.110871] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.111056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.111118] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.111332] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.111501] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.112018] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.112085] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.112246] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.112338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.112427] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.112518] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.150445] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.150624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.150671] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.150859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.152540] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.152687] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.158116] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.158244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.160093] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.160198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.160957] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.161109] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.161779] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.161916] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.165739] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.165889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.166585] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.166650] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.167339] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.167432] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.168123] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.168226] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.168922] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.169029] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.169639] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1389.170062] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.170156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.170817] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1389.171241] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.171347] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.171936] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1389.172406] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.172496] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.173075] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1389.173480] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.173576] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.174292] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1389.174679] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.174787] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d15632cf-7f81-4a48-a43d-b6ab97d126e9 is going to be deleted. [ 1389.175633] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.175838] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.177313] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.177412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.193999] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.194146] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc812c2-d9bf-4340-ac39-bbb8659329cc is going to be deleted. [ 1389.195145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.195261] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.213220] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.213375] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 161eb351-451d-49f3-803f-374b4ae2741c is going to be deleted. [ 1389.214252] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.214453] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.233928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.234182] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fca44b0a-2cfa-4faf-be9e-ed1a52fda54b is going to be deleted. [ 1389.235152] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.235383] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.237384] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.237517] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.240570] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.240672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.253068] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.253215] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30b42b8e-961a-4b49-a6b3-231d9a561dc5 is going to be deleted. [ 1389.254026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.254236] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.257233] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.257376] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.283572] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.283771] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af5e1a5e-9272-4c94-94cf-f661ba1cc217 is going to be deleted. [ 1389.284765] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.285034] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.327263] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.327263] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.328499] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.328624] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 986357b7-fd8b-4c3b-b87c-f49b9cd2664d is going to be deleted. [ 1389.329519] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.329733] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.337686] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.337686] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.392877] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.392877] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6984856-6c1b-4d02-a5b7-08f98ac851be is going to be deleted. [ 1389.393609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.393824] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.423426] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.423647] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c767742c-a318-4de7-875d-b9006231b601 is going to be deleted. [ 1389.424490] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.424799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.427641] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.427864] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.466974] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.467240] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adcaa282-9bd0-4318-8903-fc1e657e143d is going to be deleted. [ 1389.468189] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.468422] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.486471] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.486730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.508239] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.508480] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.526516] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.526705] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f87108-657a-479d-b25c-126bec380d7f is going to be deleted. [ 1389.527657] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.527876] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.577637] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.578095] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.580893] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.581122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.591603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.591796] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 307a84b6-ec60-4d35-ac8b-3997b74cc597 is going to be deleted. [ 1389.593228] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.593448] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.625609] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.647056] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.647246] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90604fb0-89c6-46f4-9cd4-5a49512e33ad is going to be deleted. [ 1389.648217] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.648477] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.662326] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.662570] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.684752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.684958] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9289966e-1f55-477f-8d5c-d3d5fe95527c is going to be deleted. [ 1389.685996] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.686298] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.755856] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.755856] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab364ad-4952-4848-9774-a09b5ae9ee0e is going to be deleted. [ 1389.756924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.757215] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.777934] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.778205] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.784208] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.784397] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.793177] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.793381] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.830349] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.830484] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4f8c658-0121-4451-aadb-f2f4c356e1b7 is going to be deleted. [ 1389.831544] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.831767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.831859] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.832039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc812c2-d9bf-4340-ac39-bbb8659329cc" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.832145] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.832294] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.832393] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.832513] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d15632cf-7f81-4a48-a43d-b6ab97d126e9" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.833253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.833253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.833253] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.833439] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-161eb351-451d-49f3-803f-374b4ae2741c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.833578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.833721] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.833833] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.833903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30b42b8e-961a-4b49-a6b3-231d9a561dc5" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.834039] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.834184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.834259] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.834508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fca44b0a-2cfa-4faf-be9e-ed1a52fda54b" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.834508] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.834624] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.834692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.834799] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af5e1a5e-9272-4c94-94cf-f661ba1cc217" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.834921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.835067] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.835141] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.835250] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-986357b7-fd8b-4c3b-b87c-f49b9cd2664d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.835371] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.835504] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.835574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.835681] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6984856-6c1b-4d02-a5b7-08f98ac851be" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.835801] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.835931] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.836008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.836121] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c767742c-a318-4de7-875d-b9006231b601" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.836244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.836391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.836505] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.836651] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adcaa282-9bd0-4318-8903-fc1e657e143d" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.836779] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.836918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.836993] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.837146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f87108-657a-479d-b25c-126bec380d7f" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.837272] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.837409] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.837483] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.837590] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-307a84b6-ec60-4d35-ac8b-3997b74cc597" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.837711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.837844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.837917] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.838042] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90604fb0-89c6-46f4-9cd4-5a49512e33ad" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.838156] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.838291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.838362] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.838467] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9289966e-1f55-477f-8d5c-d3d5fe95527c" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.897359] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.897524] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.897595] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.897829] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.897925] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.898070] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab364ad-4952-4848-9774-a09b5ae9ee0e" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.957931] env[69238]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1389.958482] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.958708] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.958788] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.959069] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.959208] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.959363] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4f8c658-0121-4451-aadb-f2f4c356e1b7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.127761] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66936bcb-aef7-4123-ae9d-1753abcc41e7: rpc.has_security_group_logging(os_id): False [ 1390.148419] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.148646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.148646] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.148823] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.173644] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.173947] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.174086] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.174155] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.174355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.174435] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.174525] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1390.235830] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.236061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.236061] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.236198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.236352] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.253907] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1391.069361] env[69238]: INFO networking_nsxv3.common.synchronization [req-4050cd35-9721-4746-a302-b54cb219d5bb req-13124b8f-103b-4782-8d28-75fa29eebb7c tempest-ServerRescueTestJSON-262352516 tempest-ServerRescueTestJSON-262352516-project-member] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1391.069894] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1391.070303] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.070433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.070498] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.070692] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.070842] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.070934] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.070990] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.071171] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.071256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.071344] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.574443] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.077460] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.267605] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1392.267831] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.580016] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.580254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.580254] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.580464] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.580556] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.580655] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 is going to be updated. [ 1392.608014] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.608175] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.608229] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.608433] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.608574] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.618426] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: IN_PROGRESS for 2s [ 1394.630212] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: SUCCESS [ 1394.630642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.071021] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.071441] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.686495] env[69238]: INFO networking_nsxv3.common.synchronization [req-4497d408-f862-4046-b795-68b3c14d187c req-69e287ed-9265-4f14-9823-d0c1dda43a82 tempest-ServerRescueTestJSON-262352516 tempest-ServerRescueTestJSON-262352516-project-member] Enqueued Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1397.687148] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 with Priority: HIGHEST for action security_group_members [ 1397.687500] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-37845621-95b4-4be5-a9ca-9ac2f7931757 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.687674] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.687781] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.688026] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.688233] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.688380] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.688479] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.688672] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.688816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.688948] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37845621-95b4-4be5-a9ca-9ac2f7931757',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.191229] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.191471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.191471] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.191698] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.214148] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.214361] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.214470] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.214535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.214730] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.214812] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.214900] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 is going to be updated. [ 1398.255595] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.255858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.255858] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.256038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.256154] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.268883] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: IN_PROGRESS for 2s [ 1400.279303] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 in Status: SUCCESS [ 1400.279680] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37845621-95b4-4be5-a9ca-9ac2f7931757 deletion is rescheduled due to dependency. [ 1400.279680] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37845621-95b4-4be5-a9ca-9ac2f7931757" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.688218] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.688218] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.689666] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.689666] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.690515] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.690788] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.691794] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.692101] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.693474] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.693881] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.007246] env[69238]: INFO networking_nsxv3.common.synchronization [req-39ffbd90-dc8e-4ee3-8364-be0c62c17e7a req-2680978d-efe7-4608-bc96-bab466d49c71 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1424.007832] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1424.008146] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.008269] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.008329] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.008523] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.008671] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.008805] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.008888] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.009038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.009125] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.009216] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.484434] env[69238]: INFO networking_nsxv3.common.synchronization [req-6922450a-894e-4254-8d71-7e7f984e8d1e req-56221168-e235-4d91-9b44-3534922dbf5a tempest-AttachVolumeNegativeTest-775029329 tempest-AttachVolumeNegativeTest-775029329-project-member] Enqueued Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_members [ 1424.485126] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 with Priority: HIGHEST for action security_group_members [ 1424.485454] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8a8e5f-f562-4849-9d65-5e443e2e8719 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.485602] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.485676] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.485836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.485987] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.486101] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.486180] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.486302] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.486412] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.486462] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8a8e5f-f562-4849-9d65-5e443e2e8719',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.512164] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.512391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.512391] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.512622] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.512720] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.512906] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.513059] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.513133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.513218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.513291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.513383] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1424.543798] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.544038] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.544097] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.544315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.544603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.554019] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1424.989699] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.989904] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.989983] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.990210] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.013047] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.013476] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.013476] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.014273] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.014273] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.014273] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.014273] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 is going to be updated. [ 1425.040182] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.040368] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.040438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.040652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.040741] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.048731] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 in Status: IN_PROGRESS for 2s [ 1426.563590] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1426.563868] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 deletion is rescheduled due to dependency. [ 1426.563921] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.059706] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 in Status: SUCCESS [ 1427.059878] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8a8e5f-f562-4849-9d65-5e443e2e8719 deletion is rescheduled due to dependency. [ 1427.059997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8a8e5f-f562-4849-9d65-5e443e2e8719" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.485900] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.486292] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.419937] env[69238]: INFO networking_nsxv3.common.synchronization [req-25cf7923-c83b-4ba2-a635-b4d0bc3c3a79 req-6da29598-1e18-45d7-8506-78b5668866e5 tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1433.421711] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1433.421711] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.421711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.421711] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.421894] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.422067] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.422163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.422256] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.422500] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.422594] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.422712] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.671982] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.672214] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.672345] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.672649] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.672916] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.673089] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.673212] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.673429] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.673575] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.673793] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1433.673971] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1433.674044] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1433.674146] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1433.674260] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1433.674368] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1433.674503] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1433.696921] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1433.697162] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1433.697257] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1433.697455] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-86" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.697777] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-31835a94-da3c-44a9-bba0-844bcd17d358 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.697951] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.698085] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.698427] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.698572] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31835a94-da3c-44a9-bba0-844bcd17d358',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.925285] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.925495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.925495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.925728] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.925836] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.925968] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.926168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.926168] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.926342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.926342] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.926451] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1433.953538] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.953752] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.953844] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.954057] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.954211] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.963593] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1434.200660] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.200877] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.201020] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.201419] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.201663] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.201869] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Segment Port 31835a94-da3c-44a9-bba0-844bcd17d358 not found, creating... [ 1434.202213] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.202443] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.202629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.202918] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.203126] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.203457] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.203629] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.203775] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.204076] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.204230] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.204394] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 31835a94-da3c-44a9-bba0-844bcd17d358 is going to be created. [ 1434.225290] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.225513] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.225641] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.225875] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.226127] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.226358] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.902949] env[69238]: INFO networking_nsxv3.common.synchronization [req-25cf7923-c83b-4ba2-a635-b4d0bc3c3a79 req-7dc434f1-21b2-4644-bb2a-a01c27e61af9 service nova] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 1434.903260] env[69238]: INFO networking_nsxv3.common.synchronization [req-25cf7923-c83b-4ba2-a635-b4d0bc3c3a79 req-7dc434f1-21b2-4644-bb2a-a01c27e61af9 service nova] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1434.903308] env[69238]: INFO networking_nsxv3.common.synchronization [req-25cf7923-c83b-4ba2-a635-b4d0bc3c3a79 req-7dc434f1-21b2-4644-bb2a-a01c27e61af9 service nova] Enqueued Resource ID: 31835a94-da3c-44a9-bba0-844bcd17d358 with Priority: HIGHEST for action port [ 1434.903508] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_rules [ 1434.903651] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1434.903774] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31835a94-da3c-44a9-bba0-844bcd17d358 with Priority: HIGHEST for action port [ 1434.904316] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.904443] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.904512] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.904851] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.904936] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.906222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.906322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.906508] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-31835a94-da3c-44a9-bba0-844bcd17d358 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.906603] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.906832] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.907008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.907087] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31835a94-da3c-44a9-bba0-844bcd17d358',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.409207] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31835a94-da3c-44a9-bba0-844bcd17d358 with status ACTIVE [ 1435.409350] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.409542] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.409642] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.409902] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.410014] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.410206] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.410306] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.410369] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.410536] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.410618] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.411044] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.411044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.411044] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.411190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.411190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.411258] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31835a94-da3c-44a9-bba0-844bcd17d358 is going to be updated. [ 1435.412668] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.412778] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.433385] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.433619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.433619] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.433796] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.433957] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.434133] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31835a94-da3c-44a9-bba0-844bcd17d358" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.974231] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1435.974625] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 deletion is rescheduled due to dependency. [ 1435.974625] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.974732] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.974903] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.975101] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.975218] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.975281] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.975452] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.975531] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.975627] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.477973] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.981836] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.484903] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.485185] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.485303] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.485601] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.485738] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.485881] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1437.513470] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.513719] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.513857] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.514190] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.514434] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.523745] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1439.535730] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1439.536122] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.536163] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.536438] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.536692] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.536816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.536922] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.537120] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.537233] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.537340] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.537449] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.905649] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.906194] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1440.039560] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.543921] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66936bcb-aef7-4123-ae9d-1753abcc41e7: rpc.has_security_group_logging(os_id): False [ 1440.560828] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.561037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.561037] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.561216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.561307] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.561587] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.561694] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.561757] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.561907] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.561982] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.562081] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1440.631809] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.632063] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.632198] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.632354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.632535] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.646787] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1442.680590] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1442.681023] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.907686] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.908187] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.214012] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.214349] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.214349] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.214619] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.214883] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.215055] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.215176] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.215387] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.215636] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.215787] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1448.215848] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] NeedRegenerationException {{(pid=69238) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1448.215961] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] no value, waiting for create lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1448.216085] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] value creation lock acquired {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1448.216197] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] No value present for key: 'zone-id' {{(pid=69238) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1448.216304] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Calling creation function for not-yet-present value {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1448.216438] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1448.238821] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1448.239034] env[69238]: DEBUG dogpile.cache.region [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69238) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1448.239155] env[69238]: DEBUG dogpile.lock [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Released creation lock {{(pid=69238) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1448.239333] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "network-809" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.239678] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock port-66f32aac-6fec-42cb-9982-cb51ca8e2c08 taken with stack trace [, , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.239853] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.239978] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.240257] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.240400] env[69238]: DEBUG networking_nsxv3.api.rpc [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f32aac-6fec-42cb-9982-cb51ca8e2c08',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.743360] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.743604] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.743674] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.743948] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.744146] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.744451] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.744617] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.744739] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.744969] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.745126] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.745416] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.745595] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.745730] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.745946] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.746099] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.746250] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Resource: SegmentPort with ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 is going to be updated. [ 1448.765565] env[69238]: DEBUG networking_nsxv3.common.locking [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.765789] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.765891] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.766192] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.766388] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.766628] env[69238]: DEBUG oslo_concurrency.lockutils [None req-9108c695-e05e-44a5-a8ae-b528e9400a5b None None] Releasing lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.433053] env[69238]: INFO networking_nsxv3.common.synchronization [req-b0204bad-d0ca-405e-a1cd-5a0cb68278f7 req-3419e743-4c83-42fb-9d17-5e203f9eb11b service nova] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1449.433306] env[69238]: INFO networking_nsxv3.common.synchronization [req-b0204bad-d0ca-405e-a1cd-5a0cb68278f7 req-3419e743-4c83-42fb-9d17-5e203f9eb11b service nova] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1449.433403] env[69238]: INFO networking_nsxv3.common.synchronization [req-b0204bad-d0ca-405e-a1cd-5a0cb68278f7 req-3419e743-4c83-42fb-9d17-5e203f9eb11b service nova] Enqueued Resource ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 with Priority: HIGHEST for action port [ 1449.433847] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_rules [ 1449.433984] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1449.434134] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 with Priority: HIGHEST for action port [ 1449.434411] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.434997] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.435094] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.435322] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.435405] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.436222] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.436335] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.436402] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.436565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.436706] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.436816] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.436889] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.436988] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.437083] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.437169] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.437942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock port-66f32aac-6fec-42cb-9982-cb51ca8e2c08 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.438053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.438053] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.438200] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.438261] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f32aac-6fec-42cb-9982-cb51ca8e2c08',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.940479] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.941592] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.941793] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.941928] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66f32aac-6fec-42cb-9982-cb51ca8e2c08 with status ACTIVE [ 1449.942763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.942763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.942763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.942763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.942763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.942763] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.942763] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.943354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.943354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.943354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.943354] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.943354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.943354] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.943678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.943678] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.943678] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66f32aac-6fec-42cb-9982-cb51ca8e2c08 is going to be updated. [ 1449.963423] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.963652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.963652] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.963875] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.964058] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.964244] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66f32aac-6fec-42cb-9982-cb51ca8e2c08" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.445853] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.949022] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.949279] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.949341] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.949578] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.949685] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.949801] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 is going to be updated. [ 1450.977991] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.978216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.978216] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.978355] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.978495] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.987154] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: IN_PROGRESS for 2s [ 1452.997786] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: SUCCESS [ 1452.998184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.998184] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.998356] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.998568] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.998737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.998737] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.998898] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.999036] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.999103] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.999163] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.501191] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.003914] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1: rpc.has_security_group_logging(os_id): False [ 1454.022992] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.023227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.023227] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.023489] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.045821] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.046276] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.046410] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.046456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.046736] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.046848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.046955] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 is going to be updated. [ 1454.110735] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.110966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.110966] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.111291] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.111449] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.125333] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: IN_PROGRESS for 2s [ 1454.434924] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.435029] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1456.144443] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: SUCCESS [ 1456.144848] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.436183] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.436574] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.437342] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.437727] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.438172] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.438521] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.439446] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.440039] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.440791] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.440791] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.442098] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.442402] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.442785] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.443209] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.869401] env[69238]: INFO networking_nsxv3.common.synchronization [req-c9a314b8-32a1-4b55-aac4-4ae3d29d3d4c req-ca1406ce-3c02-4f98-87a6-66d64c3cbf7c tempest-ServerActionsTestJSON-1240592000 tempest-ServerActionsTestJSON-1240592000-project-member] Enqueued Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1493.870048] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 with Priority: HIGHEST for action security_group_members [ 1493.870402] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-66936bcb-aef7-4123-ae9d-1753abcc41e7 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.870715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.870715] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.870813] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.870942] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.871040] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.871106] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.871237] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.871320] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.871492] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66936bcb-aef7-4123-ae9d-1753abcc41e7',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.374091] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.374240] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.374338] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.374547] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.374640] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.374827] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.374924] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.374981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.375146] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.375221] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.375307] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 is going to be updated. [ 1494.405378] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.405609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.405609] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.405792] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.405928] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.414172] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: IN_PROGRESS for 2s [ 1496.425324] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 in Status: SUCCESS [ 1496.425745] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66936bcb-aef7-4123-ae9d-1753abcc41e7 deletion is rescheduled due to dependency. [ 1496.425745] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66936bcb-aef7-4123-ae9d-1753abcc41e7" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.871597] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.871865] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.188016] env[69238]: INFO networking_nsxv3.common.synchronization [req-a567d201-66e8-4a3b-8106-525e33767ec9 req-677d4f06-6d33-4117-9d45-65f0983c93a5 tempest-AttachVolumeShelveTestJSON-91259956 tempest-AttachVolumeShelveTestJSON-91259956-project-member] Enqueued Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1500.188554] env[69238]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 with Priority: HIGHEST for action security_group_members [ 1500.188856] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 taken with stack trace [, , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.188981] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.189194] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.189404] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.189561] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.189707] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.189767] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.189918] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.190008] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.190105] env[69238]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1',) {} {{(pid=69238) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.692330] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.692565] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.692662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.692808] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.693682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.693682] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.693682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.693682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.693682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.693682] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.693682] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 is going to be updated. [ 1500.721842] env[69238]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69238) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.722111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.722111] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.722315] env[69238]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.722456] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.730473] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: IN_PROGRESS for 2s [ 1502.741662] env[69238]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 in Status: SUCCESS [ 1502.741662] env[69238]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1 deletion is rescheduled due to dependency. [ 1502.741662] env[69238]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4aac494-bde8-4f43-8d2e-0d6e0de7c3c1" {{(pid=69238) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.190081] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.190624] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.191060] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.191497] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.192826] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.192826] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.194252] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.194630] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.195906] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.195906] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.197172] env[69238]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.197526] env[69238]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0